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CHAPTER  1 


INTRODUCTION 

One  purpose  of  this  thesis  is  to  develop  methodology  for  reduced 
order  modeling  of  a large  scale  system  utilizing  the  given  system  informa- 
tion structure,  e.g.  structural  and  output  informations.  Then  using 
insights  gained  from  the  reduced  order  modeling  problem  and  the  decentra- 
lized structure  of  a interconnected  system  with  decentralized  output 
information,  control  synthesis  procedure  is  proposed  that  allows  decentra- 
lized feedback  control  for  tracking  of  interconnection  variables.  In 
addition,  the  proposed  strategy  allows  parallel  computations  without 
excessive  information  transfer  between  subsystems. 

Often  high  system  order  prevents  a detail  analysis  and  loss 
of  structural  insights.  Moreover,  often  one  is  only  interested  in  an 
input-output  behavior  of  the  system,  without  requiring  a complete  detail 
of  the  internal  system  variables.  Consequently,  a reduced  order  model  that 
best  characterizes  the  input-output  behavior  is  desirable.  The  problem  of 
obtaining  reduced  order  models  of  dynamic  systems  has  been  considered  from 
many  points  of  view,  such  as  curve  fitting,  minimization  of  some  functional 
of  the  error  between  compatibly  defined  outputs  of  the  system  and  the  reduced 
order  model,  reduction  by  continued-fraction  expansion,  by  spatial  de- 
composition (e-coupling),  by  temporal  decomposition  (singular  perturbation), 
and  by  modal  decomposition,  [17-21,  31-35].  Other  references  on  reduced 
order  modeling  may  be  found  in  literature  overviews  [36  - 38]  and  turtorial 
surveys  on  large  scale  systems  in  general  [38  - 39].  However  many  existing 
methods  produce  reduced  order  models  that  bear  no  resemblance  in  structure 


to  the  full  order  system.  In  addition,  it  is  difficult  to  relate  the 
states  of  the  reduced  order  model  to  those  of  the  original  system.  Thus 
use  of  reduced  order  model  to  design  control  strategy  to  be  used  on  the 
actual  system  can  be  unsatisfactory. 

The  methodology  for  reduced  order  modeling  proposed  in  this 
thesis  represents  an  attempt  to  eliminate  some  of  the  drawbacks  in 
existing  methods.  The  approach  is  based  on  the  chained  aggregation 
procedure,  a generalization  of  the  concept  of  dynamic  aggregation  [1]. 

It  systematically  transforms  the  system  to  a new  representation  called 
the  generalized  Hessenberg  system  representation  (GHR).  The  GHR  is 
induced  by  system  output  information  structure.  In  general  the  GHR  de- 
fines a collection  of  plausible  reduced  order  models  and  defines  in  each 
case,  the  structure  of  the  model.  It  is  shown  that  the  GHR  may  be  de- 
composed into  an  aggregate  subsystem  S*  and  a corresponding  residual 
subsystem  S*.  An  approximate  aggregated  model  may  be  obtained  by  neglecting 
the  coupling  between  S*-  and  S*  if  weak  coupling  exists.  The  residual  S* 
then  represents  a weakly  observable  subsystem  in  the  available  output. 

On  the  other  hand,  if  the  weakly  observable  part  cannot  be  simply  neglected, 
it  also  defines  a subset  of  model  parameters  appropriate  for  adjustment. 
Adjustment  of  these  parameters  is  performed  by  the  generalized  QL  (GQL) 
or  the  restriced  QL  (RQL)  algorithms  which  are  a generalization  of  the 
well  known  QR  type  algorithms  [28].  A property  of  this  generalization  is 
that  it  orders  the  system  eigenvalues  according  to  their  dominance.  Thus 
it  also  provides  a prescriptive  method  for  the  time  scale  decompositions 
and  applications  of  singular  perturbation  theory  [20]  particularly  when 
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dominant  modes  are  strongly  observable  in  the  outputs.  The  GQL  algorithm 
is  developed  in  detail  together  with  its  convergence  property  and  implica- 
tions on  the  GHR. 

Decentralized  control  design  has  been  studied  by  several  re- 
searchers [38  - 39,  63  - 65].  Earlier  works  have  concentrated  on  the 
existence  and  stabilizing  property  of  decentralized  control  [64  - 65]. 
Applications  to  realistic  large  scale  system  using  decentralized  control 
were  studied  by  Tripathy  and  Davison  [66].  It  is  shown  that  for  a large 
scale  system  with  interconnected  structures,  desirable  stability  per- 
formance can  be  achieved  by  decentralized  control  without  resort  to  the 
more  complicated  centralized  control.  However,  existing  proposed  methods 
in  general  employs  centralized  computation  in  designing  the  decentralized 
control.  This  can  be  undesirable  and  often  the  computation  savings  is 
not  immediately  clear.  To  take  advantage  of  the  decentralized  structure 
in  a large  scale  system,  often  parallel  computations  are  desirable  at 
subsystem  level.  The  actions  of  various  local  decision  makers  are 
coordinated  by  a coordinator  who  in  general  is  mainly  concerned  with 
overall  system  level  goals.  In  this  thesis,  we  adopt  an  interconnected 
composite  system  representation  where  each  subsystem  is  interconnected  to 
other  subsystems  only  through  subsystem  outputs.  Thus  if  time  evolution 
or  dynamic  equations  governing  the  desired  interconnection  inputs  are 
known,  each  set  of  subsystem  equations  becomes  independent  from  others 
providing  these  desired  interconnection  inputs  are  agreed  upon  and  achieved. 
It  is  shown  that  using  the  GHR  structural  insights  from  the  first  part  of 
the  thesis,  a hierarchical  decentralized  control  strategy  can  be  developed. 
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If  subsystem  decision  makers  mutually  agree  to  allocate  the  system  inter- 
connection variables  to  a coordinator  who  specifies  the  desired  trajectory 
base  on  some  system  level  goal,  then  a decoupling  results.  Parallel  computa- 
tions can  be  carried  out  by  subsystems  under  coordination  by  the  coordinator. 
It  is  also  shown  that  a local  control  u^  may  be  decomposed  into  three 
basic  components.  One  for  achieving  aggregation  and  decoupling;  one  for 
controlling  the  aggregate  and  thus  specifies  the  reference  system  inter- 
connections; and  finally  one  non- interactive  component,  if  exists,  allows 
the  control  of  the  residual. 

The  thesis  is  organized  as  follow.  In  Chapter  2,  the  basic  idea 
of  dynamic  aggregation  by  Aoki  [1]  is  reviewed  and  re- interpreted.  Exten- 
sion of  Aoki's  results  lead  to  the  chained  aggregation  procedure  and  the 
GHR  system  representation.  Properties  of  GHR  representation  and  other 
topics  related  to  GHR  are  studied.  Chapter  3 developes  the  generalized  QL 
theory  to  be  used  for  model  reduction  in  Chapter  4.  Algebraic  and  geometric 
convergence  properties  are  given.  In  Chapter  4,  the  model  reduction  problem 
via  the  GHR  is  studied.  The  implications  of  using  existing  model  reduction 
techniques  on  the  GHR  are  examined.  Finally,  the  GQL  theory  is  applied  to 
define  the  RQL  algorithm  for  construction  of  reduced  order  models  by  the  GHR. 
The  synthesis  of  decentralized  control  and  the  formulation  of  decentralized 
control  strategy  with  parallel  computation  is  given  in  Chapter  5.  It  is 
shown  a decomposed  optimization  problem  can  be  formulated  as  a coordinator 
level  problem  and  a set  of  local  subsystem  level  problems.  The  construction 
of  reduced  order  models  and  the  synthesis  of  decentralized  hierarchical 
controls  are  illustrated  in  Chapter  6 using  typical  large  scale  system  as 


bench-mark  models.  Performance  of  developed  methodologies  is  supported  by 
many  simulation  runs. 


6 

CHAPTER  2 

CHAINED  AGGREGATION  AND  THE  GENERALIZED  HESSENBERG 
REPRESENTATION  OF  A LINEAR  SYSTEM 

This  chapter  begins  with  a re -elimination  of  the  basic  notion 
of  aggregation  first  intorduced  by  Aoki  [1,2].  Aggregation  is  first 
viewed  as  a result  of  linear  transformation  on  the  system  and  re- 
interpreted in  terms  of  observability  of  a linear  time  invariant  system 
(LTI)  with  respect  to  the  aggregation  matrix.  The  definitions  of  complete 
aggregability  and  aggregability  are  introduced  which  facilitate  the 
extension  of  the  basic  aggregational  idea  into  a chained  aggregation 
procedure.  The  end  result  is  a new  system  representation  denoted  as  the 
generalized  Hessenberg  representation  (GHR).  The  chained  aggregation 
algorithm  which  defines  the  GHR  is  given. 

To  study  the  implication  and  significance  of  the  GHR,  several 
properties  such  as  invariant  internal  structure,  observability  and 
controllability  of  subsystems  composing  the  GHR,  and  influence  of  the 
Hessenberg  block  on  the  aggregates  are  examined  in  the  remaining 

sections  of  the  chapter,  several  illustrative  examples  are  also  given. 

2.1.  Basic  Aggregation 

The  concept  of  static  aggregation  is  well  known  to  economists. 
Dynamic  aggregation  was  first  introduced  in  1968  by  Aoki  [1].  Since  then, 
the  subject  has  been  studied  by  several  researchers  [3,4,5,6,7,10,11]. 

We  first  present  a brief  review  and  reinterpretation  of  basic  results  in 
dynamic  aggregation  [2,8].  Consider  a linear  time  invariant  system 


7 


x * Ax  + Bu 


(2.1) 


where  x?Rn,  uSRm.  A reduced  r^-th  order  aggregated  state  z^r^n. 

Is  defined  as  z^  ■ Cx  where  without  loss  of  generality  it  is  assumed  that 
the  r^X  n aggregation  matrix  C has  full  row  rank.  In  the  sense  of  Aoki, 


a linear  time  invariant  model 


*1  * FU21  + V 


(2.2) 


is  desired  to  describe  the  dynamic  variations  of  the  aggregated  state 


z^(t).  By  definition  of  z^  we  have 


zl  - CAx  + CBu 


From  (2.2)  and  (2.3),  the  aggregation  conditions  are 


CA  - FnC 


CB  - G, 


(2.3) 


(2.4a) 


(2.4b) 


system  (2.2)  is  termed  the  aggregated  model  of  (2.1).  It  is  worth 
pointing  out  that  (2.2)  is  an  exact  dynamic  aggregate  of  (2.1)  if  and 
only  if  Fj^  and  are  chosen  such  that  (2.4)  is  satisfied.  To  see 
this,  let  us  introduce  the  following  definitions: 

Definition  2.1  [1,2]:  System  (2.1)  is  said  to  be  completely  aggregable 

with  respect  to  C if  there  exists  an  r^X  r^  matrix  F^  such  that  CA*F^C. 
Generalizing  Definition  2.1,  we  have: 

Definition  2.2  [13]:  System  (2.1)  is  said  to  be  aggregable  with  respect  to  C 


if  there  exists  a matrix  C of  maximal  rank  such  that  (2.1)  is  completely 
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aggregable  with  respect  to  the  expanded  matrix 


C - 


Remark : The  generalization  to  Definition  2.2  is  a consequence  of  the 
fact  that  given  a triple  (A,B,C),  there  may  not  exist  a matrix  such 
that  (2.4a)  is  identically  satisfied.  The  possibility  of  enlarging  the 
aggregated  state  z^  which  retains  the  selected  C as  a submatrix  so  that 
CA  * FC  for  some  matrix  F motivates  Definition  2.2. 

To  examine  what  is  achieved  by  aggregation  given  (A,B,C),  it 
is  advantageous  to  view  complete  aggregation  as  an  outcome  of  a linear 
transformation  of  (2.1).  We  partition  the  aggregation  matrix  C as 


c-[cn  <ru] 


where  is  an  r^x  r^  nonsingular  matrix  (this  can  always  be  done  since 
C is  assumed  to  have  maximal  rank).  Define  the  linear  transformation  on 
(2.1)  as: 


CU  511 

Z1 

z ■ Tx,  T ■ 

0 I 

» z " 

z_ 

n~ri 

2 

““  ““ 

Application  of  (2.5)  to  (2.1)  yields 


F11 

F12 

1 

o'-1 

1 

z - j 

z + 

F21 

F22 

1 

leT 

1 

(2.5) 


(2.6) 


where 


F11  " C11A11C11  + C11A21C11 


F12  " C11A12  + G11A22  ' (C11A11  + G11A21)C11C11 


?21  " “Si0!! 


(2.7) 


F22  * A22  ' A21C11C11 


G!  * CB,  Gi  * B2 


and  A.  ,,  B , i,j  = 1,2  are  submatrices  of  A,  B of  (2.1)  partitioned 
compatible  with  T.  The  resulting  representation  may  be  considered  to  be 
an  interconnection  of  two  subsystems,  the  aggregate  subsystem  S^: 


*1  * F11Z1  + F12Z2  + G1U* 


(2.8a) 


and  the  residual  subsystem  : 


z2  " F21Z1  + F22Z2  + G1U- 


(2.8b) 


r,  X 


If  (2.1)  is  completely  aggregable.  Definition  2.1  says  a matrix  F^R  1 
exists  such  that  (2.4a)  holds.  The  partitions  of  A and  C in 


tcu  cu] 


A11  A12 


A21  A22 


= FU[CU  C1LI 


implies 


and 


C11A12  + C11A22  " (C11A11  + C11A21)C11C11  " 0 

Thus  comparing  with  (2.7),  we  see  F^sO.  Hence  the  composite  system 
reduces  to  a tandem  configuration  with  the  aggregate  subsystem  driving 
the  residual  and  no  feedback  from  the  residual  into  the  aggregate.  See 
Fig.  2.1. 


Figure  2.1.  Tandem  configuration  of  the  aggregate  and  the  residual 
subsystems  under  complete  aggregation. 

If  we  view  the  aggregated  variable  as  the  output  of  system  (2.1),  when 
complete  aggregability  occurs  (F12s°)>  the  substate  z2  is  unobservable 
through  the  aggregate.  We  realize  (2.6)  with  F12£°»  and  the  output 
equation 
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z^  * [ I 0] z 


is  an  observable  decomposition  cannonical  form  [9] . Important  and 
illuminating  connections  between  aggregation  and  observability  were 
summarized  in  [10,  11].  The  basic  conclusions  may  be  stated  as  follows: 
Theorem  2.1.  Given  a pair  (A,  C),  the  following  statements  are  equivalent: 


(a)  The  system  (2.1)  is  completely  aggregable  with  respect  to  C. 

(b)  ft  f (CA)1'}  <^,ft[CT3,  where  ^{x}  denotes  the  range  space  of  X. 

(c)  A Ker[  C}  C Ker{  C]  . 

Moreover,  if  M is  the  observability  matrix  of  (A,C),  and  rank  M=p,  then 
(A,C)  is  aggregable,  i.e.  there  exists  a matrix  C^RpXr  with  maximal 
rank  such  that  (A,C)  is  completely  aggregable,  C*[C  C ] . 

Proof:  Statements  (a)  -(c)  are  obtained  trivially  using  Definition  2.1 
and  the  observation  that  (2.6)  with  is  the  observable  decomposition 

canonical  structure.  To  prove  the  remaining  part  of  the  Theorem,  notice 
if 

; C 


rank  M ■ 


CA 


ca"-1 


then 


rank 


CA 


* rank  M 


P “ri 


CAn  • 


Select  any  p - r^  linearly  independent  rows  of  Mq  and  denote  as  C,  then  C 


i 
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induces  a map  such  that  the  representation  in  appropiate  basis  has  the 
observable  decomposition  cannonical  structure  [11].  Apply  (a)-  (c)  and 
Definition  2.1 -2.2,  the  conclusion  follows. 

2.2.  The  Chained  Aggregation  Algorithm  and  the  Generalized  Hessenberg 
System  Representation 

Given  the  LTI  system  (2.1),  the  aggregated  state  is  defined  as 
z^"Cx  where  the  aggregation  matrix  is  in  general  selected  according  to 
some  engineering  judgement  or  requirement.  For  simplicity,  hence  forth 
we  shall  choose  the  system  output  matrix  as  the  desired  aggregation  matrix. 
Thus  consider  the  following  LTI  system: 

x = Ax  + By, 

y - Cx  (2.9) 

where  y^R  is  the  available  output,  and  consider  the  problem  of  con- 
structing a reduced  order  model  that  reflects  the  input-output  character- 
istics of  the  system.  In  the  spirit  of  aggregation,  if  the  above  system 
is  completely  aggregable  with  respect  to  the  output  matrix  C then  the 
reduced  order  model  will  have  the  form  (2.2)  with  y*z^,  and  will  exactly 
describe  the  dynamics  of  the  output  y. 

However,  by  far  the  more  interesting  and  realistic  case  occurs 
when  the  system  (2.1)  is  not  completely  aggregable  with  respect  to  C; 
that  is  when  (A,  C)  is  a completely  observable  pair  or  the  observable 
subspace  is  of  dimension  greater  than  r^  but  less  than  n.  An  extension 
of  aggregation  called  chained  aggregation  is  now  proposed.  Chained 
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aggregation  is  in  essence  a sequence  of  aggregation  steps  performed  on 
successively  defined  residual  subsystems  chat  either  reduces  (2.9)  into 
a particular  observable  decomposition  canonical  form  when  (A,  C)  is 
aggregable  or  into  a structured  representation  called  the  generalized 
Hessenburg  representation  when  (A,C)  is  not  aggregable.  Let  us  first 
introduce  the  following  definition: 

Definition  2.3:  A system  representation  (F, G,D)  is  said  to  be  a Generaliz- 
ed Hessenberg  Representation  (GHR)  if 


z » Fz  + Gu 

y " Dz  (2.10) 

where 


D - [Ix  0 ...  0]*  (2.11) 
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riXri  * k 

with  Fi;L^R  , ri>ri+1  , r^n. 

Remark : The  representation  (2.10)  is  called  the  Generalized  Hessenberg 
Representation  because  the  block  matrices  F^  ^ = 0 for  i ■ 1,2, . . .k-2, 
j=i+2,...,k  and  thus  F generalizes  the  concept  of  an  n-th  order 

Hessenberg  matrix  characterized  by  f = 0 for  i * 1,2 , . . .k-2 , j ai  +2 n 

well  known  in  numerical  literature  [23]. 

Remark : Given  a triple  (A,B,C),  the  GHR  displays  a block  structure  with 
dimensions  r^,  l<i<k.  It  will  be  shown  subsequently  (Theorem  2.3)  that 
this  block  structure  is  fixed  once  (A,B,C)  is  given.  In  particular,  the 
numbers  r^  is  only  dependent  on  the  pair  (A,C),  and  is  therefore  said  to 
be  induced  by  the  system  information  structure  characterized  by  the  out- 
put matrix  C.  Furthermore,  the  system  may  be  considered  to  be  the 
interconnection  of  k subsystems,  characterized  by  the  subsystem  matrices 
F^  and  mutually  coupled  by  the  interactions  F^,  j*l,...i+l.  Hence  the 
GHR  is  a sequence  of  subsystems  coupled  so  that  each  subsystem  receives 
feedforward  signals  from  all  subsystems  preceding  it  and  a feedback 
signal  only  from  the  subsystem  immediately  following  it  in  the  inter- 
connection. The  interconnection  pattern  has  a particular  form  and  ex- 
hibits the  essential  feedback  links  within  the  system.  This  is  shown  in 
Fig.  2.2. 


r^>ri+^  always  holds  if  (A,C)  is  non-aggregable . If  (A,C)  is  aggregable, 
then  F 


J.j+1 


0,  1<  j<k-l.  In  this  case,  the  residual  which  represents 

j 


the  unobservable  subspace  of  dimension  n - £ r,  can  be  represented  by 

i=l 

a scalar  Hessenberg  form  with  r^>r^+^  still  hold  for  Vi  . 
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y 


n-nti 


Figure  2.2.  Structural  diagram  of  the  GHR  (most  feedforward  paths 
have  been  eliminated  to  simplify  this  structural  dia- 
gram) . 


Theorem  2.2:  Any  LTI  system  (2.9)  can  be  transformed  into  the  Generalized 
Hessenberg  Representation  (2 . 10)- (2 . 11) . 

This  theorem  will  be  established  by  a constructive  proof  which 
links  the  GHR  to  aggregation  [1] . The  procedure  will  be  explained  in  a 
series  of  steps,  the  steps  forming  the  chained  aggregation  procedure. 

Proof : 

Step  1 : Recalling  that  now  y * z^  and  using  (2.5)  we  have 


F 

! - fn 

j ■ j 

f' 

*12 

*2 

! ! F21 

f' 

*22 

1 + 


i x2 


(2.12) 


as  the  equivalent  representation  of  (2.9).  If  the  system  (2.9)  is 
completely  aggregable  with  respect  to  C,  s 0 and  (2.12)  is  the  GHR. 

If  not,  proceed  with  Step  2. 

Step  2:  If  the  system  (2.9)  is  not  completely  aggregable  with  respect  to 
C,  then  F^^O-  still  be  possible  to  obtain  aggregation  by  en- 

larging the  output  vector  as  a consequence  of  Definition  2.2.  To  obtain 


f 
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both  the  aggregable  subsystem  as  well  as  the  additional  output  matrix 
C,  we  proceed  systematically  by  considering  F^x2  as  the  output  of  the 
residue  subsystem  in  (2.12),  and  perform  the  aggregation  of  the  residue 
subsystem  with  respect  to  this  output. 

rlx  n? 

Denote  the  new  output  by  w2>  Since  F|2^  R , where 

t»2  ■ n-r^,  in  general  F^2  does  not  have  full  rank.  To  extract  linearly 
independent  components  of  w 2>  note  that  there  exists  a nonsingular  matrix 
E2  such  that 


E2W2  " E2F12X2 


(2.13) 


r2  X n2 

where  C2  ^ R , r2<r^,  E2  is  the  product-  of  elementary  Gaussian 

elimination  matrices  [ 12]  each  differing  from  the  unit  matrix  in  only 
certain  rows.  Define 


y2  ' C2V 


Then 


“2  * E21 


y2  ' F12y2 


Hence  the  residual  subsystem  of  (2.12)  is  now  described  by 


i2  - + F^x2  + G’u 


y2  ' Vj' 


Now  proceed  with  chained  aggregation.  Partition  C2  as 


(2.14a) 

(2.14b) 


" 
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C2  “ [C22  C22J 


(2.15) 


where  Cj  is  assumed  nonsingular,  and  define  the  X ^ nonsingular  matrix 


C22 

C22 

0 

I 

n. 

(2.16) 


where  n^'n^-r^.  Applying  (2.16)  to  (2.14)  we  obtain  after  two  chained 
aggregation  steps: 


*1  * Fllyl  + F12y2  + 


G1U 


y2  * F21yl  + F22y2  + F23x3  + G2U 


x3  “ F31yl  + F32y2  + F33x3  + G3U* 


(2.17) 


with  y^sy.  If  now  F23  = ®>  t^ie  chained  aggregation  procedure  terminates. 
If  not,  the  procedure  is  repeated  using  the  residual  in  (2.17)  namely 
(2.17c)  and  v2m^23x3  as  the  new  output  equation.  Clearly,  the  process 
of  chained  aggregation  terminates  in  a finite  number  of  steps,  i.e.  k, 
where  min  (k}  ■ 1 and  max  {k}  * n - r^.  This  completes  the  proof  of  Theorem 
2.2. 

It  is  possible  to  define  the  process  of  chained  aggregation  as  a 
sequence  of  linear  transformations  on  the  full  system  (2.9).  Define 


•fc 

If  C22  is  singular  then  a further  permutation  of  the  components  of  X2 
is  necessary  to  transform  (2.14)  into  an  equivalent  form  in  which  the 
resulting  C22  would  be  nonsingular.  Such  a permutation  always  exists. 


Ll 

*.  0 

0 


!.  i ■ l»2. 


(2.18) 


where  the  matrix  is  the  transformation  matrix  on  the  residual  similarly 
defined  as  in  (2.5)  or  as  in  (2.16)  except  for  the  i-th  step  of  the  chain- 
ed aggregation.  Then  the  transformation  H that  brings  the  original  system 
(2.9)  into  the  GHR  (2 . 10)- (2 . 11)  is 


H - Vl  Tk-2,,*V 


(2.19) 


Note  th_it  H is  lower  block  triangular  and  partitioned  compatibility  with 
the  GHR.  If,  in  general,  it  becomes  necessary  to  permute  the  components 
of  the  residue  subvector  x^  during  intermediate  steps  of  chained  aggrega- 
tion to  assure  that  Cti  is  nonsingular,  then  H is  given  by 


H " Tk-lPk-lTk-2Pk-2,*‘TlPl 


(2.20) 


where  is  the  permutation  matrix  at  i-th  step  of  chained  aggregation 
required  to  make  non-singular  (C^  defined  similar  to  (2.15)).  As  a 
consequence  H is  no  longer  upper  block  triangular. 

Remark : If  the  system  (2.9)  is  of  the  form 


x ■ Ax  + Bu 


y * Cx  + Nu 


(2.9') 


i„  ,/  - Jf.  ..  . ’ . 
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The  chained  aggregation  procedure  can  still  be  applied.  Let  H be  the  GHR 
transformation  for  (2.9)  and  applied  to  (2.91),  then 


C 

Cx 

21 

z * 

H 

x • 

Hx 

m 

z 

_ 

— J 

L_  _! 

Clearly 


y ■ z^  + Nu 

Thus  (2.10)  is  modified  to  be 

z ■ Fz  + Gu 

y » Dz  + Nu 


(2.10') 


Remark : Because  of  the  strong  relation  between  aggregability  and  observ- 
ability, the  generalized  Hessenberg  transformation  matrix  H,  (2.20)  is 
closely  related  to  the  observability  matrix  M of  the  pair  (A,C).  In 
particular  if  H1=*[H  H ] » then  H 6 span  tm^,...,mp},  p<n,  where  m^,...,mp 
is  the  set  of  linearly  independent  row  vectors  of  M.  Also,  since  chained 
aggregation  will  identify  the  observable  subspace  when  the  system  is 
aggregable,  it  is  noteworthy  to  point  out  the  relation  with  results  in 
[14,15]  concerning  the  unobservable  subspace.  The  procedures  are 
complementary  in  the  sense  that  chained  aggregation  identifies  the  observ- 
able subspace  by  gradually  extending  ft(C)  while  the  procedure  in  [ 14]  and 
related  results  in  [15]  identify  the  unobservable  subspace  by  gradually 
decreasing  ?](C) . 

Based  on  the  structure  of  the  GHR  we  now  extend  the  definition 


of  the  aggregate  and  residual  subsystems  as  follows:  Given  (2.11)  define 
Fi,Hi,Gi,Ei,Fi,  and  C*  as  follows: 


G1 


’i+l 


Sc 


Then  for  i-l,...,k-l  and  p - 2 r , the  p,-th  dimensional  subsystem 

j-1  J 

(2.22) 


z1  - hV  + eV  + Giu 


is  called  the  aggregate  subsystem  S*"  and  the  (n-p^)-th  dimensional  sub- 
system 

z1  - hV  + F1;1  + (2.23) 


is  called  the  residual  subsystem  S . 

Remark:  In  representing  a LTI  system  (2.9)  in  its  GHR,  three  distinct 
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cases  exist:  (a)  (A,C)  is  completely  aggregable.  In  this  case  F1250 

and  the  subsystem  S*  is  decoupled  from  the  residual;  (b)  (A,C)  aggregable. 

In  this  case,  there  exists  some  i £ {l,2, . . .k-l}  such  that  i+1  0 and 

the  subsystem  S*  is  decoupled  from  its  corresponding  residual  subsystem; 

(c)  (A,C)  non- aggregable.  In  Chapter  4,  it  will  be  seen  hew  S*  may  be 

used  as  a reduced  order  model  of  (2.9)  that  approximates  the  input-output 
behavior  of  the  full  system. 


2.3.  Properties  of  the  Generalized  Hessenberg  & esentatlon 

In  this  section,  we  shall  examine  several  properties  of  the  GHR 
and  some  problems  of  immediate  interest  that  relate  to  the  GHR. 

2.3.1.  Invariant  Internal  Structures  of  the  GHR 

Theorem  2.3.  The  internal  structure  of  the  GHR  characterized  by  the 
indices  r^,...,r^  is  unique. 

Proof:  It  is  sufficient  to  show  that  if  an  arbitrary  linear  transforma- 
tion is  initially  applied  to  the  system  (2.9),  rank  with  F^  defined 
as  in  (2.6),  is  invariant  with  respect  to  this  transformation.  The 


theorem  then  follows  by  induction  on  the  step  i of  the  chained  aggrega- 


tion procedure.  Given  the  system  (2.9)  let  the  transformation  (2.5) 
bring  the  system  into  the  representation  (2.6).  The  dimension  of  the 
next  layer  in  the  GHR  is  then  uniquely  defined  by  rank  F^>  with  F^ 
given  by 


F12  “ C11(A12“A11C11C12)  + C12 (A22'A21C11C12)  (2‘24) 


where  A^,  i,j  “1,2  comes  from  a decomposition  of  A compatible  with  that 
of  T in  (2.5).  Note  we  have  rewritten  C“[C^  Ci2^  ‘ 
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Suppose  an  initial  similarity  transformation  P is  applied  to 
(2.9)  and  the  system  transformed  into 


z ■ Az  + Bu 

y ■ Cz 


(2.25) 


with  z"Px,  A ■ PAP  1 and  B ■ PB.  The  only  restriction  on  P is  that  the 
leading  square  submatrix  of  C is  nonsingular.  Apply  now  the  first  step 
of  chained  aggregation  to  (2.25).  Defining,  analogously  to  (2.5),  the 
transformation 


T * 


- n 

1 -i~i 

*11 

C12 

cp  I 

. . . . T ; 

0 

I _ 

0 I 

F - TAT’1 


CP 


-1  ! 


0 I 


(PAP*1) 


CP 


-1 


0 I 


C11  C12 


P P 
r21  22 


“I  -1 
11  ~12 


C, , C, „ | 


P21  P22 


TAT 


-1 


(2.26) 


(2.27) 


Decomposte  P and  T 1 compatibly  with  T so  that 


P11  P12 


P P 
21  2 


I 

r 

C12 

W11 

W12 

A 

A - 1 

T m 

9 L 

P21 

P22 

, T - 

_^21 

W22_ 

(2.28) 
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From  (2.27)  and  in  analogy  with  (2.24)  it  is  found  that 


Fi2  - C11(A11W12  + AI2W22)  +c12<A21W12+A22W22)-  (2'29) 

But  from!  (T’1)-I,it  follows  that  +C12W22  - 0,  p2iwi2  + P22W22  " 1 


and  thus 


W12  " "C11C12W22 


W22  “ (P22"P21C11C12) 


(2.30) 


and 


F ■ F W 
f 12  12  22 


Thus,  rank  F^2  is  invariant  if  W22  is  nonsingular.  We  show  finally  that 
under  condition  that  and  are  both  nonsingular,  W22  as  given  by 

A ^ 

(2.30)  is  always  nonsingular.  To  see  this  note  that  from  (2.27)  T * TP 
and  therefore 


det  T * det 


C11  C12 


P21  P22 


+ 0. 


However,  by  assumption  det  C^1*0,  and  thus 


det  * - det  Cn.det  (p22-p21CnC12)  * 0 


Thus  W22  is  nonsingular,  and  the  proof  is  completed. 


The  next  theorem.  Theorem  2.4,  indicates  that  the  indices  r^ 


are  really  a property  of  the  pair  (A,C),  i.e.  r^i  are  completely  determined 
once  (A,C)  is  specified.  It  compliments  Theorem  2.3  in  the  sense  Theorem 
2.3  suggests  r^  are  invariant  with  respect  to  linear  transformations  and 
system  representation,  but  does  not  identify  what  determines  r^.  Assume 
H is  given  by  (2.19).  In  this  case  H is  block  upper  triangular.  Let  us 
introduce  the  following  notation: 


: Hn  h12 


H - [Htj] 


**22  ^23  ‘ 


lk  i 


\-l,k-l  Vl.k  | \ 

o i ! 


, ri  * r , 

Hij  R » * 1,2,  ...k 


Ci  “ tHi,i  Hik] 

n X r . 

A * [ A^  Aj  • • • AjJ  , Aj^  ^ R 


A1  * [A^  ...  Aj  , A1  * [A 


i+1 


(2.31) 


Note  that  the  form  of  H is  a consequence  of  (2.18)  and  can  be  shown  from 
the  steps  of  the  chained  aggregation  algorithm.  Furthermore, 


tHll  H12 


R^]  "C  and  is  nonsingular  by  assumption. 


Theorem  2.4.  Given  the  triple  (A,B,C),  a GHR  may  be  obtained  by  direct 


computation  from  the  relation 


HA  - FH 


G - HB 


(2.32a) 

(2.32b) 
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Furthermore,  the  indices  r^ . . .r^  of  the  GHR  is  completely  determined  by 
the  pair  (A,C). 

Proof:  Using  (2.31)  in  (2.32a)  and  equating  left  and  right  hand  side 
layer  by  layer,  we  have 
Laver  1 


H1A1  " F11H11 


ILjA1  “ FUtH12  Hlk]  + F12C2 


(2.33a) 

(2.33b) 


Laver  2 


Laver  1 


H2A1  " F21H11 


**2^  F21H12  + F22H22 


“ F21^H13  “*  Hlk^  +F22*’H23  H2V  +F23C3 


HiAl  * FilHll 


(2.34a) 

(2.34b) 

(2.34c) 


HiA2  * FilH12  + Fi2H22 
HiA3  * FilH13  + Fi2H23  + Fi3H33 

HiAi  " FilHli  + Fi2H2i  + '"+  FiiHii 
HiAl  * FiltHl,i+l  Hlk]  + Fi2[H2,i+l  ^.k5  + 
+ FiitHi,i+l  Hi,k]  + Fi,i+lCi+l 


(2.35a) 

(2.35b) 

(2.35c) 

(2.36) 


(2.37) 
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Notice  In  (2.32a),  although  we  can  partition  H and  F according  to  their 
general  structure,  we  know  only  , A and  r^.  The  matrices  , F£ j > and 
indices  r^  2<i<k  remain  to  be  determined.  From  (2.33a),  knowing 


is  nonsingular,  we  immediately  have 


Fn  - ViHi 


-1 

1 


(2.38) 


Thus 

F12C2  " V1  " Fll[H12  •"  Hlk]  =X1  (2,39) 

From  the  construction  of  the  GHR  through  chained  aggregation,  we  know 

rlx  r2  r2x  nl  - 

rank  F^  = rank  C2=r2.  Since  F^2  ^ R and  C2  ^ R » n^*n-r^»  it 

follows  that,  rank  Fi2C2Sr2'  By  (2.39),  X^  is  completely  determined. 
Thus 


r^  = rank  X^  (2.40) 

Furthermore,  given  a matrix  X^  with  rank  r^,  we  can  always  find  a 

factorization  F^  and  C 2 of  maximal  rank.  Thus  r2,  F^  and  C2  are 

completely  determined.  The  non-uniqueness  of  the  GHR  comes  from  the  fact 

that  the  factorization  X^  “ Fi2C2  *S  n0t  uni9ue* 

Knowing  F^,  F12,  c2  and  r2»  we  roay  move  on  to  the  equations 

of  the  next  layer  to  determine  F21>  F22,  F^,  and  r^*  To  prove  the 

theorem  for  the  i-th  layer,  let  us  assume  that  F.  , , H . , r.  for  j “1,2 

J »k  j j 

j*  1,2,.. .1-1  are  known.  In  addition,  H^,  r^  is  also  known  from  calcu- 
t h 

lations  of  i-1  layer.  Since  H is  assumed  to  be  given  by  (2.19), 
is  nonsingular  for  all  i.  From  (2.35a) 
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il 


»iAlHU 


(2.41) 


Simi larily 


Fi2  * (HiA2  " FilH12)H22 


In  general  for  a fixed  j,  j<i 


(2.42) 


j-1 


Fu  ’ “A  - W'jj 

To  obtain  i+^,  we  use  (2.37) 

F.  ,^C.^  = hY  - l.F.  .[H.  ...  H.  .1  =X, 


(2.43) 


ci,i+l  i+l 


i L u.  • , •••  11  . .j 

1 iJ  J.i+1  J.k 


(2.44) 


riXri+l 


• C, 


€Dri+lXni  - 
R , n . = 


By  same  argument  as  before,  F^  ^ R . 

i 

n-  E r . Futhermore,  rank  F^  i+i“ri+i>  rank  = ri+l  imP^ies  rank 

Fi,i+lCi+l=  rank  Xi  =ri+l’  Knowing  r.+1>  we  may  factor  X.  into  F.>i+1 
and  Ci+1  each  having  maximal  rank.  Thus  F^  k = 1,2, . . .i+1, 
have  been  determined.  By  induction,  all  submatrices  of  H and  F,  r^, 
i=l,...,k  can  be  solved  for.  In  addition,  the  matrices  H,  F and  indices 
ri  are  induced  by  only  = C and  A,  thus  is  an  invariant  property  of  the 
pair  (A, C).  Having  obtained  H,  G is  trivial  from  (2.32b).  This  completes 
the  proof. 

2.3.2.  Controllability  and  Observability  Properties  of  GHR 

Given  the  LTI  system  (2.9)  specified  by  the  triple  (A,B,C),  if 


the  system  is  aggregable,  (therefore  not  observable  by  Theorem  2.1)  then 
we  know  the  pair  (A,C)  induces  the  aggregate  which  represents  (2.9)  in 
its  observable  subspace.  On  the  other  hand,  if  (2.9)  is  uncontrollable. 
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by  working  with  the  dual,  we  can  apply  the  chained  aggregation  procedure 


to  extract  the  controllable  subspace.  In  this  sense,  the  chained 
aggregation  may  be  used  to  obtain  minimal  realization  from  a given  system 
representation.  This  is  summarized  by  the  following  theorem. 

Theorem  2.5.  Let  M and  N be  the  observability  and  controllability  matrices 
of  (A,C)  and  (A,B)  respectively.  Given  LTI  (2.9),  if  rank  MN“£<n,  then 
(2.9)  is  equivalent  to  the  representation 


F F . 
aa  ab 


0 F, 


y - [Da  D.  01 


Z,  + 0 U 

D 


(2.45a) 


(2.45b) 


Futhermore,  the  £ -dimensional  system 


! I ! 

m ■ 


F z + 
aa  a 


(2.46a) 


y ■ D z 
a a 


(2.46b) 


is  the  minimal  realization  of  (2.9). 

Proof:  Given  (2.9),  since  (A,C)  is  unobservable,  by  Theorem  2.1.  there 
is  a GHR  transformation  that  transforms  (2.9)  into 


i at  0 


F U F 
abc  cc 


y = [I  0]x 
rl 


The  aggregate 


(2.47a) 


(2.47b) 


+ C^u 


(2.48a) 


y = [I  0]x1  = B1  *. 
rl 


(248b) 


is  observable  and  uncontrollable  in  general.  Hence  its  dual 


w - Aw  + Ev 


(2.49a) 


T]  = Cw,  Tl€Rm,  W€RP 


(2.49b) 


is  controllable  and  unobservable.  Applying  a second  GHR  transformation 


on  (2.49),  we  get 


FT  0 
aa 


T T 
ab  Fbb 


(2.50a) 


11*  [I  0]w 

m 


(2.50b) 


, _T  , IX  l , 
where  F'  €R  and 

aa 


a t * T 

v = F w + D v 
a aa  a a 


(2.51a) 


11  = [I  0]w 
m a 


(2.51b) 
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is  both  controllable  and  observable  since  (2.50)  is  controllable.  Hence 

* 

(2.48)  is  linearly  equivalent  to  the  dual  of  (2.50),  i.e. 

I 


z 


f : 

aa  . 

.Y* 

z 

a 

0 : 

• 

Fbb 

Db' 

^a~| 

l 

I 

_zb 

m 


+ ! 


0 

0 


(2.52a) 


(2.52b) 


Augmenting  the  residual  of  (2.47)  and  (2.52),  (2.45)  results.  The 
observability  and  controllability  of  (2.46)  follows. 

Next  we  examine  the  observability  and  controllability  proper- 
ties of  the  aggregate  subsystem  S1  when  the  GHR  is  arbitrarily  decomposed 
into  an  aggregated  subsystem  S*  and  a residual  subsystem  S*  as  defined 
in  (2.21)  - (2.23). 

Lemma  2.1.  Consider  a linear  time-invariant  system 


. 

xi 

A11  A12 

x ! B. 

1 1 ' 

= 

. i 

I “Ti 

X2 

A21  A22 

X2  | B2  | 

(2.53) 


y * [Cj_  c2] 


*[42]  Two  representation  are  linearly  equivalent  if  the  states  are  related 
by  a linear  transformation. 


where  (A,  B)  and  (C,  A)  are  controllable  and  observable  respectively. 
Then  {a^,[A^2  B.J } and  £a22*[A21  B2] } are  completely  controllable  and 


21 

C 


, Au}  and  [ 


1*12 

Lc_i 


, A22i  are  completely  observable. 


Proof:  (A,B)  is  completely  controllable  if  and  only  if 


= n^  + n2  * n V \ €C 

I 

1 

which  implies 

rank  [A^-XI  I A^2  BjJ  * n^ 

V\6  C 

rank  [A^-Xl  '.  A^  B21  * n2 

Observability  is  established  similarly. 

If  the  system  (2.53)  is  viewed  as  a composite  system  consisting 
of  two  interacting  subsystems,  Lemma  2.1  states  that  if  the  composite  is 
completely  controllable,  then  the  individual  subsystems  are  controllable 
by  the  joint  influence  of  both  interaction  and  external  control  u.  How- 
ever, we  cannot  claim  the  controllability  of  each  subsystem  by  either 
the  respective  interaction  or  controls  alone.  Recalling  the  special 
structure  of  the  GHR,  it  follows  that  the  aggregated  subsystem  S*  is 
always  controllable  through  both  external  control  and  interactions  from 
the  residual  subsystem  while  the  residual  S*  is  always  observable  through 
both  the  available  outputs  and  the  interaction  from  the  residual  system 
that  enters  the  aggregate.  It  is  expected  that  the  influence  of  the 


rank 


All‘Xl  A12  B1 


^1  ^2 


-XI  B„ 


residual  s on  the  aggregate  S in  a given  decomposition 

of  the  GHR  is  not  solely  dependent  on  the  magnitude  of  the  interconnection, 
i.e.  llE1!!,  but  depends  significantly  on  the  controllability  of  the 
aggregate  through  the  interconnection  F^  as  weH  43  on  the  observa- 

bility of  the  residual  through  this  interconnection.  These  considerations 
prompt  us  to  examine  the  controllability  and  observability  properties  of 
subsystems  of  the  GHR. 

Definition  2.4:  The  subsystem  S is  said  to  be  interaction  observable  by 
S1  if  (E^,F^  is  an  observable  pair. 

Theorem  2.6:  Consider  the  Generalized  Hessenberg  Representation.  S is 

interaction  observable  by  S*  if  and  only  if  the  blocks  F.  ...  J4  0 V j >i. 

J » J"^ 

Proof.  Form 


33 


But  this  is  exactly  the  last  rfe  columns  of  N in  (2.54).  By  construction, 
Fk-l,k  has  ful1  rank  rk’  Hence  zk  is  interaction  observable  by  Sk  . 

Next  consider  the  interaction  observability  of  by  Sk"\  we  have 


Fk-l,k-l”X*  Fk-l,k 


rank  F.  , . F -XI 

k,k-l  rkk  KL 


Fk-2,k-l  0 


■ rank 


'k-2,k-l 


Fk-i,k-rXI  Fk-i,k 


Vk-1  Fkk‘XIJ 

V\€c 


rk-l  +rk 


By  construction,  because  each  of  Fk_2  k_1  and  F^  are  of  rank  r^.^. 


-k-2 


- 

and  r^  respectively,  then  S*'  ‘ is  interaction  observable  by  S . Moving 
from  lower  right  hand  corner,  and  proceeding  upwards,  we  establish  that 
all  residual  subsystem  S*-  are  interaction  observable  by  S1"  for  any  parti- 
tion i»l,2,...k-l  if  Fj  and  Fj  j+1  has  maxima^  rank,  j>i.  But 

this  later  condition  is  guaranteed  by  the  chained  aggregation  procedure. 
Furthermore,  note  as  we  proceed  from  the  lower  right  hand  corner  of  (2.54), 
the  blocks  proceeding  i for  the  under  consideration  do  not  enter  as 
conditions  for  interaction  observability.  Thus  only  the  blocks  F.  . for 

J * 

J>i  need  to  be  considered. 

Convesely  if  S*  is  interaction  observable  by  S*  then  the  matrix 


N^  has  full  column  rank  where 


r 
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i , l+l 


Fi+l,i+rU  Fi+l,i+2 


F ? -XT 

i+2,i+l  i+2 , i+2 


0 

0 

0 


Fk-l,k-l"X1  Fk-l,k 


' k,i+l 


’ k , i+2 


Fk,k’U 


tri+l  ri+2 
k 


rkl 


i.e.  rank  N.  * Z r,  V\6C  which  implies  f , j*i+l,...k  must  have 
j-i+1  J J 


maximal  column  rank.  For  j *k,  we  have 


i F 


k-l,k 


rank 

1 t 

1 " rk 

i 

V\€C. 

_!.k»k'xL 

ffk.k^ 

— — i 

n.  “i 

Fk-l,k  | 

Fk-l,k  J 

rank 

i ■ rank 

| j 

i: 

LVx:M 

0 

j 

Thus  Fk_^  Proceeding  inductively,  we  see  that  F^  k- 

This  completes  the  proof. 


Remark:  Theorem  2.6  is  applicable  whether  F^,  is  scalar  or  is  a block 


-i 


matrix.  This  means  the  dynamical  behavior  S is  always  observable  through 


interaction  F^  by  S*"  and  consequently  S*-  will  always  affect  the 


, 

* 1 

A 


by  S1  if  (F*,eS  is  a controllable  pair. 

Theorem  2.7.  Given  the  scalar  Hessenberg  system  representation,  then  for 

any  partition  into  S*  and  §*",  S*  is  interaction  controllable  by  S*  if  and 

only  if  f,  ...  ^0  for  all  j <i. 

J t 

Proof:  Follows  similarily  the  proof  of  Theorem  2.6,  and  is  omitted. 

The  extension  to  the  matrix  case  of  interaction  controllability 
results  of  the  scalar  Hessenburg  Representation  is  not  possible.  In 
general,  we  cannot  guarantee  the  interaction  controllability  of  S*  by 
even  with  the  assumption  of  complete  composite  controllability  by  control. 

It  is  possible,  however,  to  characterize  the  increase  in  the  dimension  of 
the  subspace  controlled  by  the  interaction  when  the  aggregated  subsystem 
is  extended  from  S*  1 to  S1.  Defining  rank  [F^-XI  E*]  *o^,  V\  *C,we 
have : 

Theorem  2.8:  The  increase  in  the  dimension  of  the  subspace  controlled  by 
the  interaction  when  the  aggregate  subsystem  is  expanded  from  S*"  ^ to 

is  bounded  above  r^  and  below  by  ri+1,  i.e.,  r^+1  <a^  - ai_1  <r  ,i"l,2 k. 

Proof:  Consider  the  rank  condition 

rank  [Fn  -\I  F^]-  ^ V\€C  (2.55) 

and 

Tu-u  f12  0“ 

rank  " a2 

^21  ^22~^^  ^23  i 


J 
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Since  rank  [F^]  *r3»  sombining  with  (2'.55)  it  ia  obvious 


+ r3  < a2  < + r2- 


Proceeding  in  a similar  manner  we  have 


rank 


,1-1 


; - at,  V \ €C 


il”  ' ’ c ii-.l  Fii‘U  Fii+l_j 


Then  it  is  obvious 


al-l+rt+lSc:iS®l.l+ri 


ri+i£!,i " ”1-1 -ri' 


2.3.3.  The  GHR  and  Its  Hessenberg  Blocks  - The  Effect  on  Output  Trajectories 


For  a GHR  arbitrarily  decomposed  into  S*  and  S*-,  S*  is  coupled 


si 


to  S only  by  the  Hessenberg  block  F^  Thus  it  is  of  interest  to  study 

the  influence  of  the  Hessenberg  blocks  on  S*  and  S^.  The  present  section 
will  characterize  the  trajectory  deviations  when  a particular  interconnection 
F^  i3  neglected  from  S In  the  next  section,  the  influence  of 

the  Hessenberg  blocks  will  be  assessed  from  an  eigenvalue  perturbation 
point  of  view  if  F^  i+1zi+^  severed  from  S1. 

We  recall  that  when  (A,C)  of  (2.9)  is  observable  (and  thus  non- 
aggregable),  none  of  the  F^  in  the  GHR  will  be  zero  and  thus  no  de- 
coupling of  the  aggregate  from  the  residual  exists.  On  the  other  hand, 
when  (A, C)  is  unobservable,  this  decoupling  exists.  Lying  between  these 
two  extremes  is  the  case  when  the  residual  is  only  weakly  observable  at  the 
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growth  of  e^(t)*z^(t)  -z^(t)  small.  We  ask  specifically: 

• How  does  e^(t)  evolve  in  general? 

• What  is  the  asymtotic  behavior  of  e^(t)? 

• Which  interconnection  ^+^zi+^,i  “1, . . .k-1  results  in 

T 1/2 

minimum  growth  of  lle^(t)]|V  t where  !|e^(t)||  = { tx  ei(t)e^(t)}  ? 

Instead  of  asking  how  well  (2.56)  approximates  (2.57)  when  u * 0,  let  us 
assume  controls  are  non-zero,  but  bounded,  i.e. 

u€U-  {u(t)  J Hu  ( t ) II  <K<  ® V t } (2.58) 

Define 

e^t)  - zi(t)  - zt(t)  (2.59) 

Theorem  2.9  and  Corollary  2.9  characterize  the  evolution  of  and  asymtotic 

behavior  of  lie  (t)l|.  The  proofs  are  given  in  Appendix  A. 

Theorem  2.9:  Consider  the  approximation  of  (2.57)  by  (2.56).  If  there 
exists  constants  c^,  p^,  i=*l,2,  then  e^(t)  satisfies: 

ll*i(t>ll4*5+  <ki  +K2)e“t  + 

(2.60) 

where  p^,  k^,  or  and  ^ are  defined  in  Appendix  A. 

Corollary  2.9:  Assume  F*  and  F*  are  stable  matrices  under  the  hypothesis 

of  Theorem  2.9,  then 

ck, 

0<  lim  He,  (t)l!  < — ^<»  (2.61) 


(kj^  +k2  +k3)|j,2+(k|Qr+k2crt-k1")y,+k1"a 
M-(a  + M-) 


(or+v)t 
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if  and  only  if  a + p.<0.  (a,u  and  are  defined  in  Appendix  A). 

Remark:  From  the  definition  of  k^,  we  see  if  u belongs  to  the  class  of 
controls  that  exponentially  approaches  zero,  then  |!e(t)!l  also  approaches 


zero  as  t — «. 

Now  for  a given  decomposition  of  the  system  into  S*  and  S^,  any 
one  of  F^^  may  be  neglected  in  order  to  approximate  (2.57)  by  (2.56), 
resulting  the  approximate  GHR  and  its  associated  instantaneous  error  norm 
!|ei(t)||.  Because  of  the  fact  that  y and  y are  subvectors  of  z*"  and  z^ 
small  growth  in  e^(t)  warrants  the  conclusion  that  the  growth  of  y(t)- y(t) 
is  also  small.  An  essential  exponential  in  (2.60)  that  indicates  the 

( 1+  St 

growth  of  e^(t)  is  e^a  u ' where  the  quantities  a and  y,  are 

appropiately  indexed  as  a*,  a^ , a*-  and  p,S  i £ {1,2, . . .k-l)  according  to 
partitions  in  the  GHR.  We  observe  three  possibilities: 

Possiblity  (a) : 
i -i  a1  < 0 

F , F stable  =*>  *>  for  minimum  instantaneous 

/ 1 1 ^ \ ..  A . 


(a  + y,  ) <0  possible 


x>  for  minimum  instantaneous 
norm  l]e  (t)l|  or  small  growth 
in  j|e^(t)!|,  we  desire  a small 
(a  +y,  )• 


Possibility  (bj 


F*,  F*  unstable  *> 


al>  0 


(a  + |±^)  >0  always 


,>  for  minimum  growth  on  tie  ^ (t ) M , 
we  desire  a small  (a^+nS. 


Possibility  (c) 


F1  stable,  F1 


unstable  or  vice 


a1  > 0 

^ (q<^  + ^)  >0  always 


for  minimum  growth  in  He ^ ( t ) l| , 
we  desire  a small  (a^+iiS* 


> 
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Thus  the  requirement  to  keep  the  growth  of  lle^(t)H  small  can  be  related 
as  keeping  the  value  of  (£**"+ nS  aa  small  as  possible.  Such  conclusion 
can  therefore  be  interpreted  as  a criteria  for  choosing  i £ f 1 , . . .k-l} * X 
such  that  the  influence  of  Hessenberg  blocks  on  introducing  small 

error  between  (2.56)  and  (2.57)  may  be  ranked.  Define 

^ - a1  + u,1 , i * 1, . . .k-l  (2.62) 

Then  of  the  k-l  approximation  (2.56),  the  interconnection 
if  neglected,  where  j is  defined 
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be  solely  governed  by  the  aggregate  S*  (see  section  2.3.2).  Denote  the 
system  matrices  of  (2.56)  and  (2.57)  with  index  i suppressed: 

(2.63) 

and  let  a(A)  denote  the  seu  of  eigenvalues  of  A.  If  c(Ac)  and  cr(Ac)  have 
similar  eigenvalue  pattern  or  eigenvalues  that  are  close  in  numerical 


F E 


H F 


F 0 


H F 


values,  then  the  dynamics  of  y(t)  can  be  expected  to  be  close  to  that  of 
y(t).  In  fact,  due  to  the  structure  of  the  GHR  (S^  is  coupled  to  S* 
through  only  F^  i+xzi+l^’  c^oseness  of  y to  y may  be  explained  by 
the  idea  of  weak  coupling  when  eigenvalue  separation  exists  between  cr(F) 
and  a(F)[22].  Since  this  need  not  be  the  case,  we  shall  study  how  the 

A 

eigenvalues  of  Ac  differ  from  those  of  Ac  and  to  bound  the  eigenvalue  of 
Ac  in  terms  of  a Gorschgorin  disc  [23]  if  this  is  possible. 

A A 

Let  \L,  \L  denote  the  i-th  eigenvalue  of  A c and  Ac  respectively. 
Also  let  x^,  y^  be  the  normalized  eigenvector  and  adjoint  eigenvector  of 

A A A _ 1 

A„  corresponding  to  \..  X is  defined  as  the  modal  matrix  of  A and  Y = X 
c i c 

A 

Furthermore,  AA  =A  -A  where 

' f*  n n 


A A 


c 


(2.64) 


For  simplicity,  assume  Ac  and  Ac  each  have  distinct  eigenvalues.  We  wish 
to  bound  in  terms  of  the  perturbation  AAC>  The  following  lemmas 


are  necessary. 
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Lemma  2.2.  Given  nxn  matrix  A*  [a.  i,j”l,...n.  Every  eigenvalue  of 

A lies  in  at  least  one  of  the  discs  (Gorschgorin  discs)  with  center  a^ 

and  radius  E a. , I . 

J * i 

Lemma  2.3.  [23]  If  s of  the  Gorschgorin  discs  form  a connected  set  which 
is  isolated  from  other  discs,  then  there  are  precisely  s eigenvalues  of  A 
within  this  connected  set. 

Base  on  Lemma  2.3,  the  objective  is  to  isolate  the  Gorschgorin  disc 

in  which  \ lies  from  the  rest  by  using  linear  transformation  on  A , thus 
1 C 

reducing  the  radius  of  each  disc.  Using  the  definitions  of  various  quanti- 
ties given  in  Appendix  B,  we  have  the  following  theorem. 

A 

Theorem  2.10:  Consider  the  matrices  Ac  and  A defined  by  (2.64),  then  the 
i-th  Gorschgorin  disc  of  Ac  can  be  isolated  from  the  rest  so  that 


V0ii'ri^i^i+f3ii  + ri 


(2.65) 


where  0 syt  AAC  x^  , i,  j=l,...n  if  and  only  if  the  following  conditions 
hold  : 


(I) 


max 

j 

j *i 


I 

k*  j 
k*i 


3jk> 


< 1 


t(Xi  + 3ii) 


(W 


(II)  Yt  < Yt 

where  0 , y^  and  y^  are  defined  in  Appendix  B. 

The  proof  of  Theorem  2.10  is  given  in  Appendix  B.  An  example  will  be  given 
at  the  end  of  the  section  to  illustrate  the  theorem. 

Finally,  by  treating  AAC  as  a perturbation  on  Ac,  we  note  one 


r.  /•  *» 


I -r  I 
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may  study  the  sensitivity  of  eigenvalues  of  Ac  with  respect  to  4 Ac . 
Definition  2.6:  Let  the  first  order  sensitivity  matrix  of  Xk  with  respect 
to  AAC  be  defined  as 


o(l)  = 
x k " 9E 


ax 

ae 


, E-[e 


(2.66) 


and  che  total  first  order  change  of  Xk(Ac)  with  respect  to  AAC  be  defined 
as 


A X, 


(D  = 


tr  E 


S<1> 

x k 


(2.67) 


To  see  the  validity  of  (2.67),  let  E=  [e.  ] be  a 2x2  matrix,  then 

> J 


a \k  axk  a xk  a xk 

= en  aT^7  + ei2  aT^  + e2i  a^+  e22  ae2“  * 

Remark : The  left  subscript  x in  ^S^denotes  the  sensitivity  given  a 
particular  matrix  representation.  This  is  important  because  sensitivities 
are  not  invariant  to  linear  transformations  on  matrix  representations. 


Applying  the  results  on  eigenvalue  sensitivity  with  respect  to  a 
parameter  [24],  we  have 


XkXk 


Denote  E 


fEijI,  then 

a x. 


a.\ 


ae 


ij 


ae 


ij 


ax , 


ax,. 


^k  3e 


ij 


ij 


which  gives 
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3Ac 

cirf^v  yk> 

< V yk> 


(2.68) 


where  the  right  hand  side  of  (2.68)  is  evaluated  according  to  Ac . Hence 
to  first  order: 


X 


k 


+ A X 


(1) 

k 


We  note  the  computation  of  the  sensitivity  matrix  is  relatively  simple 

A 

because  the  eigenvector  and  adjoint  eigenvector  x^,y^  of  Ac  may  be 
obtained  from  lower  order  computations  due  to  the  lower  block  triangular 

A 

structure  of  Ac. 

The  following  simple  example  illustrates  Theorem  2.10  and  the 
eigenvalue  sensitivity  with  respect  to  AAC. 

A 

Example.  Consider  a scalar  Hessenberg  matrix  A_  and  an  approximate  A. 

c c 

where , 


2.5 

1.2 

0 

0 

-2.5 

1.2 

0 

0 

1.0 

1.5 

0.1 

0 

A 

1.0 

1.5 

0 

0 

A = 

, A - 

c 

1.4 

2.2 

0.62 

-3.43 

c 

1.4 

2.2 

0.62 

-3.43 

0.6 

1.6 

0.96 

-4.3 

0.6 

1.6 

0.96 

-4.3 

First  let  us  consider  the  bounding  of  X^  using  the  Gorschgorin  disc.  The 
matrix  0 is  computed  to  be 


0 


! 0.008009 

j 

-0.039071 
-0.00915 
| 0.021968 


-0.0180304 

0.08796 

0.020603 

-0.049455 


0.0180445 

-0.088028 

-0.020619 

0.049494 


-0.02747 

0.13401 

0.031389 

-0.075348 


w 
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According  to  (B8)  of  Appendix  B,  the  lower  bounds  for  p£  are  p^  “ 0.069 
p^  “0.033,  p3  “0.061  and  p^  “0.059.  Choose  pi“0.5  Vi,  it  is  trivial  to 
show  exists  for  Vi  and  r^  “ 0.00263,  r2  “ 0.01306,  r^  “ 0.00335  and 
r.  “0.01734.  The  results  are  tabulated  in  Table  2.1. 


Table  2.1.  Estimates  of  \t(Ac)  based  on  \ (Afi)  and  the 
bounds  of  Gorschgorin  discs. 


Eigenvalues  of 
Ac  :Xi 

Eigenvalues  of 

* A 

Ac  : Xt 

Estimated  Bound  on  X, 

i 

-2.7725 

-2.7804 

-2.77502  <\1  <-2.7697 

1.865 

1.7804 

1.855  <X2<  1-881 

-3.5215 

-3.501 

-3.5251  <\3<-3.5183 

-0.25104 

-0.17904 

-0.271  < X4  < -0.237 

Next  consider  the  first  order  eigenvalue  sensitivities  with 
respect  to  f33“0.1  in  Ac.  The  sensitivity  matrices  of  \^,  i*  1,2, 3, 4 are 
defined  according  to  (2.66)  and  (2.68)  while  the  total  first  order  varia- 
tion is  computed  according  to  (2.67). 


ax, 

Te — 


ax3 

“3e~  ’ 


-0.285681 

-0.040774 

ax2 

’ 8E 

1 0.20549 

0.096208  j 

0.080091 

0.011431 

1 

i 

' 0.879594 

0.411818  | 

* ' 

-0.076532 

-0.091946 

ax. 

0.156713 

0.036507 

-0.206189 

-0.247716 

II 

1* 

-0.753484 

-0.175529 



1 

and 


A “ 0.0080091  , 

A X2I}  - 0.0879594 

d “ -0.0206189  , 

A \(4U  “ -0.0753484 

46 


The  computed  results  and  comparisons  are  tabulated  in  Table  2.2 


Table  2.2.  Eigenvalue  estimate  of  Ac  based  on  eigenvalues  of 
Ac  using  1st  order  sensitivities. 
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CHAPTER  3 

THE  GENERALIZED  QL  ALGORITHM 

The  scalar  Hessenberg  matrix  has  been  used  extensively  in 
numerical  analysis.  It  is  useful  in  eigenvalue  analysis  [23,25-27], 
particularly  in  conjunction  with  the  powerful  QR  algorithms  developed  by 
Francis  [28] . Extensive  treatment  is  also  given  by  Wilkinson  [23] . 

Working  with  the  upper  scalar  Hessenberg  matrix  F,  the  QR  algorithm  factors 
F into  an  unitary  matrix  and  a upper  triangular  matrix,  and  iteratively 
transform  F into  a upper  triangular  matrix,  thus  displaying  the  eigen- 
values on  the  diagonal.  Taking  advantage  of  the  block  structure  of  the 
generalized  Hessenberg  matrix,  we  envision  a parallel  development  for  the 
purpose  of  exhibiting  weak  coupling  between  some  aggregate  S*'  and 
associated  residual  S*,  if  such  weak  coupling  indeed  exists  in  the  given 
system.  The  result  is  the  generalized  QL  (GQL)  algorithm  developed  in 
this  chapter.  We  point  out  that  weak  coupling,  if  it  exists,  is  a function 
of  system  representation,  and  is  only  exhibited  in  certain  particular 
system  representations.  The  GQL  algorithm  does  not  introduce  weak  coupling, 
it  merely  transforms  systems  into  a more  suitable  representation  to  bring 
out  weak  coupling.  The  motivation  for  using  the  particular  generalized  QL 
algorithm  is  found  in  the  fact  that  its  successful  application  to  the  GHR 
would  have  the  effect  of  reducing  in  the  limit,  the  plant  matrix  in  the 
GHR  from  generalized  Hessenberg  form  to  block  triangular  form.  In  that 
process,  some  Hessenberg  blocks  will  be  converging  to  zero  matrices. 
Depending  on  the  rate  of  convergence,  the  algorithm  is  expected  to  place 
in  evidence  after  a finite  number  of  iterations  those  Hessenberg  blocks 


F ^ Chat  may  be  neglected  with  acceptable  approximation  error.  The 

main  objective  is  to  understand  under  wt  .. 'itions  convergence  occurs 

and  how  the  algorithm  may  be  applied  to  bring  out  any  weak  coupling  within 
the  system  structure. 

The  generalized  QL  algorithm  to  be  developed  is  a particular 
variant  of  the  standard  QR  algorithm  [23,28]  and  is  constructed  for  the 
block  partitioned  Hessenberg  matrices.  At  each  Iteration,  Che  system  matrix 
in  the  GHR  is  factored  into  the  product  of  a block  unitary  matrix  Q and  a 
lower  block  triangular  matrix  L,  each  compatibly  partitioned  as  the 
generalized  Hessenberg  system  matrix.  The  QL  factorizations  stem  from  the 
needs  of  reduced  order  modeling  to  be  described  later  while  the  block 
structure  is  consistent  with  the  GHR  structure. 

The  chapter  is  organized  as  follows.  In  Section  3.1,  the  funda- 
mental QR  algorithm  is  modified  to  obtain  the  basic  QL  algorithm.  The 
extension  to  block  Hessenberg  matrix  results  in  the  generalized  QL  (GQL) 
algorithm  which  is  presented  in  Section  3.2.  The  extension  to  block  matrices 
leads  to  a whole  class  of  problems  which  must  be  investigated.  In  particular, 
the  convergence  and  computational  aspects  of  the  generalized  QL  algorithm 
are  presented  in  Sections  3.3  and  3.4  respectively.  Finally,  the  applica- 
tion of  the  generalized  QL  algorithm  to  GHR  is  briefly  discussed  in 
Section  3.5,  leaving  the  model  reduction  problem  via  the  GHR  and  GQL  in 
the  next  chapter . 
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3.1.  The  Basic  QL  Algorithm  and  its  Properties 

Let  A be  an  arbitrary  but  real  nX  n matrix,  Q a nX  n unitary 
matrix,  and  L a nXn  lower  triangular  matrix.  Then: 

Result  1:  The  factorization  A ■ QL  is  always  possible. 

Result  2:  The  factorization  A = QL  is  unique  if  A is  nonsingular  and  the 
diagonal  elements  of  L are  restricted  to  be  positive  and  real. 

Let  A^=A,  then  the  QL  algorithm  is  defined  by  the  following 
ierative  procedure: 


A * Q L 
s xs  s 


As+1  “ LsQs 


s = 1,2,3, .. . 
s = 1,2,3, .. . 


(3.1) 

(3.2) 


where  the  factor  matrices  Qs  and  Lg  are  unitary  and  lower  triangular 
respectively  and  subscript  s denotes  iteration  number.  Then 
Result  3:  All  Ag  are  similar  to  each  other,  and,  in  particular,  are  similar 
to  A1- 


Result  4: 

Let  Pg  a QlQ2  . 

• • Qg j Ug  — L§ • Then 

(i) 

As+1  “ 

Qs  • • • QIVl  • • • Qs  3 PsAlPs 

(3 

■ 3) 

(ii) 

PsUs  * 

(3. 

.4) 

Thus  PgUg  achieves  a QL  decomposition  of  A^. 

Result  5 : Given  a nX  n matrix  A^  with  real  eigenvalues.  Then  the  QL 
algorithm  converges  to  a lower  triangular  matrix  A with  eigenvalues  of  A^  on 
the  diagonal  in  ascending  magnitude,  that  is, 

diag  A - (XL Xn) 


Uj_l  < 1*2 1 < ” ' l*nl 


I 

iL  . 
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Result  6:  Given  A with  distinct  real  or  complex-conjugate  pairs  of  eigen- 
values, the  eigenvalues  in  the  limiting  matrix  A are  again  ordered  with 
respect  to  their  absolute  value  as  in  Result  5,  with  the  distinction  that 
2X2  diagonal  block  entries  correspond  to  complex-conjugate  pairs  of 
eigenvalues . 


3.2.  The  Generalized  OL  Algorithm  and  its  Properties 

As  in  the  case  of  QR  algorithm,  the  QL  algorithm  presented  in 
Section  3.1  is  applicable  to  any  arbitrary  initial  matrix.  It  has  been 
noted  in  [28]  that  the  amount  of  computation  is  significantly  reduced  if 
the  initial  matrix  is  Hessenberg.  Instead  of  concentrating  the  development 
on  arbitrary  block  matrices,  a generalization  of  the  QL  algorithm  suitable 
for  application  to  the  generalized  Hessenberg  matrix  of  the  GHR  is  now 
developed.  Consider  the  system  matrix  F of  the  GHR  (2.10).  For  notational 
purposes  denote  F by  F^ . The  factor  matrices  Qi,  L^ , i*l,2,...  are  said 
to  be  compatible  with  F^  if  they  have  the  same  block  partitions  as  F^ . 

The  generalized  0L  algorithm  states 


F = Q L 
s xs  s 


Fs+1  = Ls*s 


s - 1,2,3,... 
s ■ 1,2,3, .. . 


(3.5) 

(3.6) 


where 

Q * nX  n block  unitary  matrix  compatible  with  F, 
s 1 

L s nXn  lower  block  triangular  matrix,  compatible  with  F.  . 
S 1 


The  following  results  then  hold: 
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Theorem  3.1:  Given  a matrix  F in  generalized  Hessenberg  form,  the  factori- 
zation F = QL  is  always  possible  where  Q is  unitary  and  L is  lower  block 
triangular  and  each  compatible  with  F. 

Proof:  The  theorem  will  be  proved  by  a constructive  procedure  referred  to 
as  the  successive  orthogonalization  method.  Since  F = QL  and  using  the 
notation 


[Fl  ...  Fk]  tQL  •• • Qkl 


J11 


0 0 


L21  L22 


^1  * ' * \k 


(3.7) 


where  F^  are  nXr.  matrices  and  are  r^  matrices.  We  have 


^k^ck 


Fk-1  " VA-l.k-l  + Vlc.k-l 

K m QiLii + Qi+iLi+i,i + ••• + (3‘8) 

F1  * Q1L11  + Q2L21  + + 


The  successive  orthogonalization  method  starts  by  choosing 
T * 

such  that  QkQk  = 1^-  This  is  always  possible  if  columns  of  Qk  are 

T 

orthonormal  vectors.  From  (3.8a),  we  immediately  have  Lkic  = QkFk*  Next  we 

T T 

choose  Qk_1  such  that  Qk_^Qk_^  * an<*  Qk_^Qk  = 0.  This  is  always  possible 

if  columns  of  are  chosen  such  that  each  column  of  Qk  ^ is  orthogonal  to 

each  column  of  Qk  and  all  columns  of  Qk_^  are  mutually  orthonormal.  From  the 


Here  denotes  the  r^ X r^  dimensional  identity  matrix. 


52 


T T 

second  equation  of  (3.8)  we  get  Lk_1  k_1  * Qk_1Fk_1  and  * W-l/  Ia 

general,  Q,,  i =*  k,k-l, . . . , 1 are  chosen  in  succession  starting  from  such 

that:  (a)  columns  of  are  mutually  orthonormal  and  (b)  each  column  of 

T 

is  orthogonal  to  each  column  of  Q ^ , i < j ^ k,  i.e., 

T 

QiQj  = 0 Vj  > i.  This  is  always  possible.  Once  is  selected  and  since 
Q..,  j>i  are  known  from  previous  steps,  we  have 


T 

Lii  = Vi 
Li+l,i  = Qi+lFi 

^,1  = 


(3.9) 


Thus  the  matrix  L is  obtained  block  column-wise  starting  from  the  kth  block 
column.  Clearly  each  L^,  Vi,  j = 1,2, . . . ,k  is  well  defined  and  with  Qi> 
i = l,2,...,k  appropriately  selected,  the  generalized  QL  factorization  of  an 
arbitrary  generalized  Hessenberg  matrix  always  exists. 

Analogous  to  Fact  2,  the  generalization  to  block  Hessenberg 
starting  matrix  is 

Theorem  3.2:  The  decomposition  F = QL  is  unique  if  F is  nonsingular  and  L 
is  restricted  to  have  positive  definite  (negative  definite)  and  symmetric 
diagonal  blocks  Vi. 

Proof:  By  hypothesis  F is  nonsingular,  thus  L is  nonsingular  with  positive 
definite  diagonal  blocks  ^ = ^'ti*  f * 1»2» • . . ,k.  Assume  that  there  exists 

two  decompositions  such  that  F ” = Q2L2 ' Defining 

V = q£Ql  - L^'1  (3.10) 


being  unitary  gives 


■**  ' — i-2i 
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T T T 
V v = = 1‘ 


(3.11) 


Thus  equating  both  sides  of  (3.11)  and  using  (3.10)  we  have  V = diag(V.  .), 
r .Xr . 11 

VU6R  1 i,  with  Vhirh,  i = 1,2, ...  ,k.  From  (3.10)  V..  - L2(i * ^[lJ1 ’ l}]  '1 

Hence  = L^1’ i)TL^i,l\  If  L(l,i)  is  restricted  to  be  symmetric 

and  positive  definite  (or  all  negative  definite),  then  ^ which 

implies  = 1^  and  it  follows  that  and  = Q2 . This  proves  that  if 

L is  restricted  to  have  positive  definite  and  symmetric  diagonal  blocks, 

then  the  QL  decomposition  is  unique.  It  should  be  noted  that  a unique 

decomposition  F = QL  can  be  attained  if  F is  nonsingular  and  L is  restricted 

to  have  negative  definite  and  symmetric  diagonal  blocks  for  all  i. 

However,  there  is  no  loss  in  generality  in  taking  the  to  be  positive 

definite . 

Theorem  3.3  (i):  All  Fg  are  similar  and  thus  similar  to  the  initial 

generalized  Hessenberg  matrix  F.  ; (ii)  define  P =Q....Q  and  U =L  ...L,  . 

1 s 1 s S s 1 

5 q 

Then  PgUg*F^,  i.e.,  PgUg  achieves  a QL  decomposition  of  F^. 


Proof:  (i)  by 

definition,  F = 
s 

= QgLg,  then 

T 

OF  Q = 
^s  sxs 

’ Fs+1' 

In  particular, 

T 

F , - Q . 

s+1  xs 

■ • • • • % ■ PsVs  • 

(11) 

PsUs  = <*l  • 

Vi<Wl.-i  •••  h 

* *1  • 

" <!9-2<!s-lFsls-lLs-2  •"  li 

- F1Q1 

5' 


Theorem  3.4:  Given  an  initial  generalized  Hessenberg  matrix  F,  all  CL 
iterates  are  structurally  invariant,  i.e.,  all  Fg  are  generalized  Hessenberg 
matrices  compatibly  partitioned  as  in  F. 

Proof : If  F is  nonsingular,  the  assertion  is  obvious  because  Lg  will  be 
nonsingular  and 


"s+1 


L L ....  L.FL'1  ...  L'1 
s s-1  11  s 


U FU-1. 
s s 


Since  Ug  is  lower  block  triangular  and  compatibly  partitioned  then  Fg+^, 


Vs  =1,2,...  will  be  generalized  Hessenberg  and  compatibly  partitioned.  If 
F^  is  singular  the  result  can  be  shown  to  hold  by  recalling  the  possi- 
bilities of  structuring  the  block  matrices  in  Q via  successive  orthogonali- 

T 

zation.  From  (3.8)  we  have  = ^kFk  and  t*lus 

0 


Sk-iQlk  •••  &i,k<£.kl 


k-l,k 


k,k  J 


Qk-l,kFk-l,k  +Qk,kFk,k' 


(3.12 


By  selecting  Qk_1>k  and  k. 

From  the  submatrices  of  the  block  matrix  QL  and  using  the  structure  of  F, 
we  have  Q^kI-kk  * 0 Vi  * 1,2, . . . ,k-2  and  arbitrary  I^k  implies  Qik  = 0 
Vi  * 1,2, . . . ,k-2 . In  a similar  manner,  k-1  Sc-lFk-l  shows  that 

Lk_i  k_1  is  independent  of  for  i * 1,2, . . . ,k-3 . Thus  by  the  same 

argument,  k_^=0  For  * " 1»2, . . . ,k-3 . The  rest  is  by  induction.  Thus  the 


L , can  be  made  to  take  on  arbitrary  value. 


unitary  matrix  Q is  also  generalized  Hessenberg.  Consequently  F^  = LQ  is 
also  generalized  Hessenberg. 


r 
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3.3.  Convergence  of  the  Generalized  QL  Algorithm 

Having  established  the  existence  and  uniqueness  of  the  generalized 
QL  factorization  and  defined  the  GQL  algorithm,  consider  next  its  conver- 
gence properties.  Both  a geometric  and  an  algebraic  approach  are  used. 

From  the  geometric  point  of  view,  we  shall  first  show  the  relationship 
between  the  generalized  QL  algorithm  and  the  power  method  used  in  numerical 
procedures  for  eigenvalue  extraction  [29] . Based  on  the  properties  of  the 
power  method,  conclusions  on  the  convergence  of  the  QL  algorithm  will  be 
drawn.  In  addition,  it  will  be  shown  that  if  the  generalized  QL  algorithm 
converges,  a partial  ordering  or  eigenvalues  will  be  induced  so  that  the 
leading  submatrix  of  the  limiting  matrix  F contains  the  dominant  eigenvalues, 
i.e.,  eigenvalues  with  smallest  moduli.  On  the  other  hand,  the  convergence 
process  and  the  structure  of  the  limiting  matrix  F at  convergence  is  best 
illustrated  using  an  algebraic  approach.  Furthermore,  partial  convergence 
is  defined  and  its  implication  on  generalized  Hessenberg  strating  matrix  is 
studied . 

From  the  proof  of  Theorem  3.3,  we  note 


F = £im  F , , = lim  PF.P  . 
s -<a  S+l  s-00  SIS 


(3.13) 


Thus,  Fg  converges  to  a constant  F if  and  only  if  Pg  - P as  s — « . On  the 
other  hand,  from  Theorem  3.2,  the  factorization  FS=QSLS  is  not  unique  if 
F,  (thus  F ) is  singular.  Since  P = Q.  ...  Q , in  order  to  prove  conver- 
gence  of  the  GQL  algorithm,  it  is  necessary  to  assume  unique  factorization 
at  each  iteration.  Henceforth,  except  noted  to  the  contrary,  it  is  assumed 
that  F^  is  nonsingular.  Such  an  assumption  may  not  be  unreasonable  because 
many  systems  possess  nonzero  eigenvalues. 


. ..  ••  s 


; • - ' •'  • „ " 
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From  Theorem  3.3, 

Ps  - Ffc1.  (3.14) 

Because  Ug  is  lower  block  triangular,  (3.14)  implies  that  the  last  q block 

columns  of  P are  linear  functions  of  the  last  o block  columns  of  the 
s 

matrix  F^.  Let  the  nX  n identity  matrix  I be  partitioned  compatibly  with 
F^,  i.e., 

Ix  0 0 0 

0 i2  0 0 

1 = : 0 •••  Wi  ••• 

: : . o 

oo  o i, 

k 


The  following  notations  and  definitions  will  be  used  in  the  sequel.  We 
define  as  the  space  spanned  by  the  last  q block  columns  of  I,  i.e., 

e = a{iq} 
q 

where 


Let  31  be  the  linear  operator  corresponding  to  the  matrix  F,  and  let  Z be 
1 1 o 

an  arbitrary  subspace  of  ft0  spanned  by  p linearly  independent  n-vectors 
xl,x2’ ‘ • ,Xp*  An  iterative  sequence  of  subspaces  {^*g}  will  be  denoted  by 
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X * 3.  s = l,2,... 

s 1 1 O i.  O 


(3.15) 


and  Z will  be  called  the  starting  subspace  of  Z . Let  the  eigenvalues  of 
o s 

and  their  respective  eigenvectors  be  ordered  by  their  modulus : 

UJ  > U2I  > > |xnl 

12  n 

Then  any  p dimensional  subspace  spanned  by  the  leading  p eigenvectors  is 
called  dominant  in  modulus.  If  | X ^ | = |X  ^|,  then  there  will  be  more  than 
one  such  dominant  in  modulus  invariant  subspaces.  Let  ^(p,ftn)  denote  the 
set  of  all  such  dominant  in  modulus  spaces.  By  cardinality  of  a set,  we 
refer  to  the  number  of  elements  in  that  set.  When  card  (p ,Rn)  = 1 , we  shall 
denote  this  unique  dominant  in  modulus  invariant  subspace  by  D(p,ftn).  In 
general,  for  an  arbitrary  nX  n matrix  A compatible  with  a given  generalized 


Hessenberg  matrix  F,  let  (A)^  denote  the  submatrix  of  A consisting  of  the 
last  q block  columns  of  A and  (q ) ^ be  the  subspace  of  ftn  spanned  by  the 
linearly  independent  columns  of  (A)^.  Furthermore,  we  introduce  the 
following  definitions: 

Definition  3.1:  An  operator  3^  in  (1°  is  said  to  be  defective  if  there  are 
less  than  n linearly  independent  eigenvectors  for  F^,  where  F^  is  the  matrix 
representation  of  3^  in  ftn. 

Definition  3.2:  Let  X be  an  arbitrary  p dimensional  subspace  of  and  TJp 
be  a p dimensional  invariant  subspace  of  3^.  2p  is  said  to  be  deficient  in 

^ V^O. 

Remark:  If  Z„  is  not  deficient  in  7?  , then  Z_  is  a complement  of  7IC.  i.e.. 

P p p q 

ft"  In  this  case  it  is  equivalent  to  say  2p  and  7?p  must  not 


. ^ ~ - 
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contain  common  elements.  However,  in  general  we  cannot  claim  Z contains 

P 

or  vice  versa.  A simple  example  shows  this.  Let  7 ^ * span{x^,x2}, 

~p  * span  {x^}  where  x^  are  linearly  independent  and  x^^R^-  Clearly 

R * span{x1,x2,x3} . Let  Zp  = spanfxj+x^ ,x2]  * spanfv^v^.  Clearly 
c 3 

2p®7Zp  = R but  neither  Z ^ contains  7?p  nor  7?p  contains  Zp. 

From  (3.14),  we  note 


<?sK  - 


(3.16) 


q 1 s 'q 

Since  Zs  must  converge  Vq  tn  order  for  Fg  to  converge,  the  convergence  of 
vg  must  be  guaranteed.  2g  is  formed  by  3^  repeatedly  operating  on  columns 
of  Ug^.  Thus  the  following  facts  are  necessary: 

Fact  1 [29]  : For  an  arbitrary  vector  x€Rn,  let  and  V„  be  the  eigen- 
values  of  A with  maximum  modulus  and  its  associated  eigenvectors.  Under 
appropriate  conditions,  the  power  sequence  {aSs,  s *0,1,2, ] converges  to 

V 

For  the  simplest  case  of  distinct  eigenvalues,  this  may  be  seen 
as  follows.  Let  uq  be  an  arbitrary  n-vector  and  define  two  sequences  u and 


t by 
s 


/max  (tg+i) , s “0,1,2,... 


s+1  s+1' 

:s+l 

where  max(x)  equals  the  element  of  maximum  modulus  of  x.  Then 


t = Au  , s *0,1,2,... 


ASu 


max (AS  uq ) 


s - 0,1,2,  . . . 


Next  express  u in  terms  of  the  eigenvectors 


Hence 


“o ' tSiVi- 


- • — - • 
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Since  |\i|  < |XM|  Vi,  then  as  s-“,  if  we  have 

ASuo  ~ 

Also  max(ASuQ)  ~ X^a^nax  , giving  us 


ASu 


u = 
s 


M 


, . s . max  (VA) 

max  (A  uq)  M' 


The  more  general  case  of  repeated  eigenvalues  may  be  found  in  [23]. 

Fact  2 [29] : For  arbitrary  n-vectors  x,  y,  and  z,  the  subspace  spanned  by 
x,  y,  z and  its  successive  iterates  obtained  by  the  power  method: 


rS  S S 1 Sr  i 

lx  ,y  ,z  ] “A  lx,y,z] 


under  appropriate  conditions,  converges  to  the  invariant  subspace  spanned 
by  eigenvectors  associated  with  eigenvalues  of  largest  modulus. 

The  following  lemma  from  [29]  then  allows  us  to  relate  the  con- 
vergence of  the  generalized  QL  algorithm  to  that  of  the  power  method. 


Lemma  3 . 1 [29]  : If  3 is  a nondefective  operator  in  iin  and  card  ii(p,Rn)  = 1, 


then  the  power  sequence  '•  ’ where  Z m span[x^ , . . . ,x  ) converges  to 
D(P»ftn)  linearly  as  §-•  if  and  only  if  Z is  not  deficient  in  D(p,^n). 

Lemma  3.1  may  be  interpreted  as  follows.  In  order  for  the  initial 


space  to  converge  under  the  power  method,  Z must  not  contain  common 


c n 

elements  with  D (p,il  ) which  is  the  invariant  subspace  formed  by  the  n-p 


eigenvectors  other  than  the  p eigenvectors  associated  with  the  p eigenvalues 
of  maximum  modulus. 


1 


i 


r 
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A relationship  between  the  generalized  QL  algorithm  and  power 
method  may  be  established  as  follows.  Since  is  lower  block  triangular, 
it  is  obvious  that 


From  (3.16),  we  have 


(u  ) ee  . 

s q q 


ffff 


1 q 


(3.17) 


where  ~ denotes  equivalency.  Comparing  (3.16)  and  (3.17),  we  conclude 

that  the  sequence  U,  } is  generated  from  the  starting  subspace  t . In 

a q 

particular,  the  generalized  QL  algorithm  is  seen  to  be  equivalent  to  a nest to 
sequence  of  k power  sequences  with  starting  spaces  For  the 

convergence  of  the  generalized  QL  algorithm,  we  immediately  have  the 
following  theorem. 

Theorem  3.5:  The  generalized  QL  algorithm  converges  if  and  only  if  the 
power  sequence  “ {3S£  ] converges  for  all  q = l,2,...,k. 

s q 


Furthermore,  in  view  of  Fact  2 of  the  power  method,  if  the  gener- 

q’ 


alized  QL  algorithm  converges,  (0g)^,  Vq*l,...,k  converges  to  the 


Z r.  =ra  dimensional  subspace  of  R spanned  by  the  m eigenvectors 
i-k-q+1  1 « <1 

corresponding  to  the  m^  eigenvalues  of  largest  magnitude.  In  other  words, 
P ■ Hnj  P is  ordered  such  that  columns  of  (P)  spans  D(m  ,ftn).  Because 


iS  PsFlPs 


T 

PFjP 


l l 

then  the  leading  Z^r^X^Z^r^  submatrix  of  F will  represent  the  restriction 

Ji 

of  F to  the  eigenspace  spanned  by  the  Z r,  eigenvectors  corresponding  to 

i«l  1 

smallest  modulus.  Hence  we  can  conclude  that  the  leading  submatrix  of  F 


— 
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always  contains  the  dominant  (eigenvalues  with  smallest  modulus)  eigenvalues 
of  F1- 

Theorem  3.6:  If  the  generalized  QL  algorithm  converges,  then  the  eigen- 
values of  the  leading  submatrix  of  the  limiting  matrix  F are  the  dominant 
eigenvalues  of  F^ . 

Using  Lemma  3.1  and  Theorem  3.5,  the  convergence  of  the  generalized 
QL  algorithm  may  be  stated  as  follows: 

Theorem  3.7:  If 

(i)  3^  nondefective,  and 

n k 

(ii)  3 has  a unique  eigenspace  D(m  ,ft  ) , m = E r.  corresponds  to 

1 <3  q i=k-q+l  1 

m^  eigenvalues  of  largest  magnitude,  and 

(iii)  F^  is  nonsingular  and  generalized  Hessenberg, 

then  the  generalized  QL  algorithm  converges  if  and  only  if  (£^)^  is  not 
deficient  in  D(m^,Rn)  Vq  = k,k-l, ..., 1, where  (£-^)^  denotes  the  space 
spanned  by  the  last  q block  columns  of  L^  from  the  decomposition  F^  =Q^L^. 


Proof : Rewrite  (3.14) 


FiusX  = f^V'1,...^;1). 


Consider  an  alternate  sequence 


Hence 


ips  ■ FiLil- 


W,  ' 


N°w  1PS“*1FS  if  and  only  if  Vq,  (X^)q  is  not  deficient  in  D(mq,Rn).  Since 
(L^  ...  Lg  ) is  also  lower  block  triangular  of  the  same  form  as  L.\  thus 

«;V«qlv 
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S “1 

Hence  3,  in  effect  operated  on  (£,  ) in  (3.16).  Thus  P converges  if  and 
only  if  converges.  This  proves  the  assertion. 

In  order  to  understand  the  causes  of  convergence  in  general 
and  what  is  the  structure  of  the  limiting  matrix  F,  let  X be  the  modal 
matrix  of  , then 

Fx  * XDX'1  - XDY  (3.18) 

where  D is  block  diagonal  and  compatible  with  F. , i.e.,  D= block  diag 

ri*ri 

D = block  diag  (A^,A2 > • • • ,A^)  , A^  € R . If  S(A^)  denotes  the  spectrum  of 
A^,  then  min  S(h^),  max  S(A^)  denotes  the  eigenvalues  in  S(A^)  with  minimal 
and  maximal  modulus  respectively.  Assume  further  than 

max  S(At)  < min  S(A.+1),  i«l,...,k-l.  (3.19) 

Note  that  cases  with  eigenvalues  of  equal  moduli  including  repeated  eigen- 
values have  not  been  ruled  out.  The  only  assumption  is  that  eigenvalues 

with  equal  moduli  may  be  grouped  into  a particular  Ai  and  thus  satisfy 
★ 

(3.19).  Factorize  Z and  Y as 


QL 

(3.20a) 

UL 

(3.20b) 

where  Q is  unitary,  L is  lower  block  triangular,  U is  unit  upper  block 
triangular  (i.e.,  unit  matrices  on  the  main  block  diagonal) and  L is  lower 
block  triangular.  Moreover,  Q,  L,  U,  and  L are  all  compatible  with  F^ . 
Using  (3.20)  in  PgUg  - F®, 


This  depends  on  the  number  of  eigenvalues  of  equal  modulus  and 
on  r.  which  is  determined  by  the  structure  of  the  generalized  Hessenberg 
matrix  F|. 


j 
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P U 
s s 


XDSY 


QLDSUL 


ql(dsud's)dsl. 


(3.21) 


Since  U is  unit  upper  block  triangular. 


[dsud'sL 


i»  j 


0 


i<j 

otherwise 


(3.22) 


Hence  we  can  write 


s - s 
D UD 


I + E 


(3.23) 


where  Es  is  upper  block  diagonal  with  zero  main  diagonal  blocks  and  for 
j>i,  the  (i,j)th  block  is  given  by  (3.22).  Due  to  (3.19),  D„  has  eigen- 
values with  larger  moduli  than  those  of  D. . . Then  lim  E =0.  Using  (3,23) 

11  s— s 

in  (3.21),  we  have 


P U 
s s 


= QL(I+Es)DSL 
= Q(1  +LEgL’1)LDSL 
* QQs-LsLDSL 


(3-24) 


where  the  product  QgLg  results  from  a generalized  QL  decomposition  of 

— 1 — — 3 

I + LEgL  . Because  Q and  Qs  are  unitary  and  Lg,  L,  D , and  L are  lower 
block  triangular,  it  follows  from  the  uniqueness  of  the  QL  decomposition 


QQ3 


U = L LDSL. 
s s 


(3.25a) 

(3.25b) 


Moreover,  from  the  fact  that  lim  E =0,  it  must  be  that 

g-.00  S 

lim  L = I 

g— 00  S 

lim  5-1. 

s— ao  s 


k 


* 
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Hence 


and 


Furthermore , 


lim  P = Q * constant  matrix 
s— ® s 


lim  U * lim  LD  L. 

S— CO  S g_co 


g^  FS+1  " P3F1PS  " ^ ^ 


and  using  (3.18) 


F * QT(XDX_1)Q  = LDL_1. 


(3.26a) 

(3.26b) 

(3.27) 

(3.28) 


Equations  (3 . 26) - (3 . 28)  show  Fg  indeed  converges  and  the  limit  F will  be 
lower  block  triangular  and  compatible  with  F^.  In  other  words,  when  the 
GQL  algorithm  is  applied  to  a generalized  Hessenberg  matrix  F,  the  Hessenberg 
block  (Fs)^  will  tend  to  a zero  matrix  when  convergence  is  achieved. 

Thus  convergence  is  a consequence  of  (3.22)  and  the  assumption  that  has 
eigenvalues  with  larger  moduli  than  those  of  D^. 

Next  consider  the  relationship  of  geometric  and  algebraic  approaches 

and  the  implications  of  (3.19)  on  the  convergence  of  the  GQL  algorithm. 

Using  (3.25b)  in  (3.14),  we  get 

_ _s  =r-l  -s  -1~-1 
P = F.  • L D L L • 
si  s 


In  addition,  (3.25b)  indicates 


(rVV^"1) 

s 'q 


j’1 

s 


lV1, 

s s- 1 


Since  U_*  - L_  L_‘,  ...  L (K/) 


g 1 ) 

s q 


(i'V8!'1!"1) 

s 'q 


<>q- 


Thus 


r 


■flkM  ■ 3 
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In  view  of  Theorem  3.7,  we  are  interested  in  the  relationship  of 

(I^D  S£  *3^)  and  D(mq,Rn).  To  this  end,  using  (3.20)  and  (3.25),  we  find 


~-l  -sT  -lr-1  „ T -sT  -1~ 

L D L L - Q • LD  L Q 
s'  xs 


(3.29) 


'**  — g - 2-  — g - 2 

Because  Q "I  as  s— =>,  LD  L Q LD  L . From  (3.29),  we  conclude 
s s 

(£‘1il'si:'1rl)q  ~ (?)q.  (3.30) 

Recall  Q“XL  ^ where  X is  the  modal  matrix  of  with  columns  ordered 

according  to  (3.19).  Since  rank  (Q)  = rank(X)  , (^)  ~ D(m  ,Rn) . From 

9 9 9 9 

(3.27)  we  conclude  (£  s£  ^)  ~ D(m  ,ftn) . Hence  (3.1)  is  not 

s q 9 1 9 

deficient  in  D(mq,ftn).  Thus  Theorem  3.7  guarantees  the  convergence  of  the 
generalized  QL  algorithm  as  long  as  F^  has  nonzero  eigenvalues  and  the 
eigenvalues  of  F^  may  be  grouped  according  to  (3.19). 

In  the  remaining  part  of  the  chapter,  we  shall  introduce  the 
notion  of  partial  convergence.  The  motivation  lies  in  the  fact  the 


dimensions  of  the  submatrices  F 


(i,i) 


F.  . of  the  GHR  are  defined  apriori 

y 


once  the  output  matrix  C is  specified  in  the  original  system  representation. 
It  is  possible  that  eigenvalues  with  equal  moduli  appear  in  successive  blocks 
A^  of  (3.19).  The  simplest  example  occurs  when  the  output  is  one  dimensional 
and  there  exist  complex  conjugate  pairs  of  eigenvalues  so  that  due  to  the 
dimension  of  blocks  F^’^  (which  is  1 by  1 if  output  is  scalar),  one  complex 
eigenvalue  is  associated  with  and  its  complex  conjugate  is  associated 
A . . . In  view  of  (3.22),  lim(DSUD  The  nonzero  elements  will 

i x S-ro 

have  constant  modulus  but  different  in  argument  for  each  value  of  s.  To 
this  end,  let  us  introduce  the  following  definition. 


liMM MMafl  1 . m ^ 
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Definition  3.3:  The  generalized  QL  algorithm  is  said  to  have  partial 

convergence  if  there  exists  a set  Xq'-X  with  X0  ~ £qr  >q^  >--*>q  }> 

1 ^2  rt 

X = £ 1 , 2 , . . . ,k-l}  such  that 

(qt.qi+i) 

J5*.  -0 

To  see  that  Fs  still  converges  to  a lower  block  triangular  matrix  as  s-*<*> 
but  not  all  i^-  converges  to  a zero  matrix,  let  us,  for  simplicity, 

assume  that  A^,  At+^  have  eigenvalues  of  equal  modulus.  The  extension  to 
more  general  case  where  there  are  isolated  groups  of  A^s  with  eigenvalues 
of  equal  modulus  is  obvious.  Equation  (3.19)  now  becomes 

max  S(A^)  < min  S (A2>  < • • • <Tmax  S(At)<min  s (At+1)  < • • * <~max  S (A^_1)  < min  S (A^) . 

(3.31) 

Then  instead  of  (3.23),  we  may  write 


dsud's  - U +E 

s s 

where  lim  E *0,  with  U_  of  the  form 
g_O0  s s 


(3.32) 


X1  0 

0 i2  0 


Lt-1 


Lt+1 


t+2 


0 

0 


>:k 


(3.33) 


Recall  from  (3.21), 


■MM 
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PgUg  = QL(DSUD_ S)DSL 

= xus(i  + iT1es)dsl 

= XUg(I+Gg)DSL 


where  lim  G = 0. 

s— 03  s 


Writing  XU  =Q  L then 
s s s 

V,  ■ Vs(I+VD Si 


or  as  s-*00 


Q ~ P . 
s 


Hence 


f = p’t.p 

s+1  sis 


T -1 
* P XDX  P 
s s 


Now 


If  we  define 


~ L (U  LDU  )L_1. 

S S s'  s 


XUe  = QLU  = Q L . 
s x s xs  s 


and 


Qs  - Q 


w 


0 

-1 

s 

0 


0 

W. 


’ Ws€R 


LU 


pXp 


P’V^t+l 


Clearly  they  satisfy  (3.35).  Denote 


L11 

. 0 

L21 

h.2 

L31 

L32 

0 

0 

L33 


and 


t+1 


(3.34) 

(3.35) 
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from  (3.34)  we  have 


I 0 

0 

I 

0 

0 

Fs+1~ 

0 W 

s 

0 

ldl”1 

0 

w'1 

s 

0 

_°  0 

I 

_0 

0 

I 

r—i 

f—1 

< 

1 

0 

0 

~ 

wsi22w;1 

0 

1 

r*  > 

u> 

H 

l32 

“s' 

A 

L33_ 

where  L. . 
ij 


Vi,j  are  independent  of  iteration  number  s,  and 


W L-W"1  = W L__ 
s 22  s s 22 


t 

0 A 


0 

t+1 


L'V 

L22Ws 


1 


(3.36) 


Thus  as  s-*00,  Fg+^  eventually  becomes  a fixed-structure  lower  block  tri- 
angular matrix  except  for  block  rows  and  block  columns  corresponding  to 
A^  and  At+r  Even  though  the  diagonal  blocks  correspond  to  A^  and  do 

not  converge,  their  eigenvalues  are  those  of  A^  and  A ^ as  a consequence  of 
(3.36). 


3.4.  Computational  Aspects  of  the  GQL  Algorithm 

Successive  iterates  of  the  generalized  QL  algorithm  requires  the 
factorization  of  Fg  into  block  matrices  Qg  and  Lg  and  obtain  Fg+1  as  i a (3.6). 

In  this  case,  both  factor  matrices  Q and  L must  be  solved  for.  Alternatively. 

S3  J 9 

the  successive  GQL  iterates  may  be  obtained  as  a result  of  linear  transfor- 
mation using  the  relationship 
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» 


F , , = L F L_1 
s+1  s s s 


# s 1 » 2 , • . • 


(3.37) 


While  there  are  many  computational  procedures  for  the  standard  QR  algorithm 
that  may  be  adapted  to  the  generalized  QL  algorithm,  the  presence  of  block 


structure  in  Fg , Qg  and  Lg  and  with  reasonably  small  dimensions  associated 


with  each  block,  new  alternative  approaches  may  be  developed.  In  view  of 


(3.37),  it  is  sufficient  to  obtain  Lg  only  in  order  to  obtain  the  next 


iterate  Fg+^.  We  have  from  (3.5) 


T T 

F F = L L . 
s s s s 


(3.38) 


When  F and  L are  written  in  terms  of  their  block  entries 


F " [FV...,TV], 


L = 


J11 


0 0 


L21  L22°--° 


hcl 


^k 


(3.39) 


then  equating  both  sides  of  (3.38),  we  find  that 

k 


T T ^ T 

L . . L,  = F . F . - E L . L . , 

Lx  Li  1 1 m-i+1  ml  ml 


i = k,k-l , . . . , 1 


Li1  = (Lii)"1[FiF1  ‘ 1 LmiLmi]  * J * 1,2 i-1. 

11  1 J m=i+l  ml  mJ 


(3.40) 

(3.41) 


(3 .40)- (3 .41)  constitute  a set  of  recursive  equations  for  L,  of  course 


-1 


knowing  L,  Q * FL  . While  (3.38)  always  has  a nonsingular  Lg  as  a solution, 


it  is  not  evident  that  this  solution  may  be  constructed  to  be  lower  block 
triangular  and  have  symmetric,  posiitive  definite  diagonal  blocks  as  required 
for  uniqueness  of  factorization.  An  examination  of  (3.40)  indicates  that 
may  be  solved  for  only  if  the  right  hand  side  of  (3.40)  is  at  least 
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positive  semi-definite  and  L„  may  then  be  obtained  using  (3.41)  only  if 
the  right  hand  side  of  (3.40)  is  positive  definite.  We  now  proceed  to  show 
that  under  the  assumption  of  nonsingularity  of  F^ , the  right  hand  quantity 


of  (3.40)  is  indeed  positive  definite.  From  (3.8), 

k k 

LT.L..  = [F.  - Z 0 L . ] T[  F.  - Z QL  . ] . 
ri  li  l n^i+l™  ml  1 ra=i+l  “ ml 

Expanding  the  right  hand  side  and  using  (3.9),  we  have 

m m k _ km  km 

L..L,  . = F.F.  + Z L ,L  . - Z L .L  . - Z L .L  . 
n n ii  m=i+l  ml  ml  m=i+l  1111  ml  m=i+l  ml  ml 

= ftf.  - Z lt.l  . . 

1 1 m=i+l  ml  ml 


(3.42) 


(3.43) 


Thus  (3.42)  is  equivalent  to  (3.40).  We  can  conclude  that  the  right  hand 
side  of  (3.40)  is  at  least  positive  semi -definite . Due  to  the  non- 
singularity of  L,  the  right  hand  side  then  must  be  positive  definite.  It 
is  obviously  symmetric.  Note  during  step  i,  all  quantities  on  th*  right 
hand  side  have  already  been  obtained.  From  [30],  a unique  positive  definite 
and  symmetric  exists  using  (3.40).  Thus  when  Q is  not  explicitly 
required,  (3 .40)-(3 .41)  provide  a simple  set  of  equations  for  L. 

Next  consider  the  solution  of  (3 .40)- (3 .41) . Denote  the  right 
hand  side  of  (3.40)  by  , i = k ,k-l , . . . , 1 . The  problem  therefore  reduces 
to  solving  a quadratic  equation  for  L^,  inverting  the  and  then  solving 
for  . For  a fixed  i,  the  right  hand  side  of  (3.40)  is  completely  defined 
from  previous  calculations.  Since  is  symmetric  and  positive  definite, 

then  the  matrix  of  eigenvectors  of  is  unitary.  Denote  the  matrix  of 

eigenvectors  of  by  then 
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,T?L? . L.  . V.  = VTQ.V.  = diag(\1i,>i,...,Xi  ) = A 
x 11  11  1 ixi  i 12  r.  i 


(3-44) 


where  } = O'Cq^}  - denotes  the  set  of  eigenvalues  of  . 

i 

Thus 


giving  us 


l?.l. . = (V.A^V1) (V.A^V1) 

1111  ' 1 1 l' V 1 1 l' 


L,  . - V.A%VT 

11  111 


(3.45) 


which  is  symmetric  and  positive  definite  if  \f  is  taken  to  be  positive. 

Once  is  obtained,  L^ ^ , j * 1,2, . . . ,i-l  may  be  obtained  by  using  (3.41). 
Note  block  submatrices  of  L are  obtained  successively  starting  from  the  kth 
block  column.  See  Figure  3.1  for  a summary  of  the  algorithm. 


3.5.  Application  of  the  Generalized  QL  Algorithm  to  the  GHR 

While  the  generalized  QL  algorithm  may  be  used  solely  for  numerical 
purposes,  we  recall  the  primary  goal  to  develop  the  GQL  theory  is  to  apply 
it  to  the  GHR  so  that  any  weak  interconnection  between  S1  and  S1 , if  it 
exists,  may  be  brought  into  evidence.  However,  we  stress  the  GQL  algorithm 
does  not  create  weak  interconnections,  it  merely  reorganizes  system  repre- 
sentations, and  in  that  process,  block  diagonalizes  the  system  matrix 
according  to  eigenvalue  magnitudes.  We  discuss  two  particular  aspects. 

The  first  is  the  use  of  the  factor  matrix  L in  F = Q L as  a linear  trans- 
formation  of  the  GHR  and  show  the  general  effect  of  GQL  algorithm  on  GHR. 

The  second  is  how  the  property  of  GQL  algorithm  may  be  used  to  advantage 
when  applied  to  the  GHR  in  order  to  indicate  a two-time  scale  decomposition 
of  the  system  into  a fast  and  a slow  subsystem.  While  the  second  aspect  is 


73 


in  fact  a particular  consequence  of  the  first  aspect,  its  repercussions  are 
of  separate  significance  because  of  applications  within  the  theory  of 
singular  perturbation  [20] . The  generalized  QL  algorithm  provides  a pre- 
scriptive procedure  for  identifying  slow  and  fast  subsystems  and  thus 
represents  a convenient  tool  for  achieving  thisccrucial  step  for  the  appli- 
cation of  singular  perturbation  results. 

In  view  of  (3.28)  which  gives  the  structure  of  the  limit  F,  we 
observe  that  under  conditions  of  convergence  some  or  all  of  the  super 
diagonal  blocks  in  Fg  will  gradually  reduce  towards  the  zero  matrix  and,  thus 
would  tend  to  become  weak  links  in  the  system  structure.  If  indeed  some  of 
these  links  may  be  neglected  with  acceptable  approximation  error  this  would 
result  in  the  residual  being  unobservable  to  the  aggregate,  achieving  an 
approximate  aggregation.  Thus  the  aggregate  may  become  an  acceptable  reduced 
order  model  of  (2.9).  We  now  make  the  above  discussion  more  concrete  by 
applying  the  sequence  of  similarity  transformations  characterized  by  the 
matrices  Lg , s = 1,2,3,...  to  the  GHR.  Denote  the  GHR  from  (2.10)  as 

*1  = F1z1  + G^,  (3.46) 

y« ' Dzi'  y„SRl 

with  z = z^,  F = F^,  and  G = G^  employed  to  simplify  the  notation  in  this 
section.  Since  F^  is  nonsingular,  it  has  a unique  block  QL  decomposition 
(Theorem  3.2)  F^~Q^L^.  Premultiply  (3.46)  by  . Then 

Llzl  " L1F1Z1  + L1G1U  " L1Q1L1Z1  + LiGlU* 

Define  z 2 * Lizl»  G2  = L1G1'  T^en  zi  ~ *2Z2  + G2U  anc3  ^m  = DL]/22-  A. 
sequence  of  transformations  yields  the  system  representation: 


T 


where 


zs+l 

= F 

S+ 1 

Zs+1  + GS+1U 

ym 

= dl'1 

. . . L_1z  = 

s s+1 

DU"1Z 

S 2 

zs+l 

= L z 
s s 

= L . . . L,  z. 
s 11 

■ U z. 
s . 

Gs+1 

= L G 
s s 

=•  L . . . L,  G. 
s 11 

35  U G 
s 

(3.47) 

(3.48) 

(3.49) 


Since  U = tt  L.  is  lower  block  triangular,  the  r. -dimensional 
s i=i  1 1 

leading  subvector  of  zg  is  the  transformed  measured  output  y . This  is 
precisely  why  we  require  the  decomposition  F * QL  instead  of  F = QR.  Otherwise, 
the  transformed  output  y will  be  a linear  combination  of  all  system  states 
zg+^  instead  of  measured  output  only.  This  is  crucial  because  we  want  to 
"preserve"  relationship  between  the  measured  outputs  and  state  variables  of 
any  reduced  order  model  constructed  from  the  GHR. 

The  usefulness  of  the  GQL  algorithm  in  singular  perturbation  theory 
stems  from  Theorem  3.6.  Traditionally  singular  perturbed  system  assumed 
the  structure: 

Sg : x^  = A1 1x1  + A1 + B1 u (3.50a) 


Allxl  + A12X2  + Blu 


Sf : x2  = l/|i(A21x1 +A22x2 +B2u)  (3.50b) 

where  M>  is  a small  parameter  and  the  fast  eigenvalues  (nondominant)  of  the 
composite  system  is  associated  with  the  fast  subsystem  S^.  Unfortunately, 
many  systems  possessing  a two-time  scale  property  are  not  directly  expressed 
in  the  form  of  (3.50).  Thus  a systematic  procedure  to  be  applied  to  a general 
system  representation  so  that  (3.50)  results  will  be  useful. 

The  effect  of  applying  a sequence  of  QL  iterations  on  the  system 
structure,  as  depicted  in  Figure  2.2  of  Chapter  2,  is  that  the  subsystems 
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will  eventually  be  ordered  so  that  , as  an  independent  subsystem,  contains 
the  dominant  dynamics,  is  the  system  with  which  the  next  group  of  eigen- 
values, in  order  of  dominance,  is  associated,  and  so  on  to  the  last  sub- 
system which  is  the  fastest  subsystem  as  it  is  associated  with  eigenvalues 
with  largest  moduli.  It  is  however,  important  to  note  that  as  the  iterations 
are  allowed  to  go  to  infinity,  while  the  essential  feedback  links  would  tend 
to  become  weaker  and  weaker,  the  effect  of  the  iterations  on  some  other 

parameters  is  to  make  them  larger  and  larger,  e.g.,  allow  them  to  grow 

s ~ 

unboundedly.  To  see  this  recall  that  from  (3.25b),  lim  Ug  = LD  L,  and  when 
contains  eigenvalues  with  modulus  greater  than  one,  Ug  will  grow 
unbounded.  Thus  if  the  QL  algorithm  is  applied  to  the  final  goal  of  reducing 
all  superdiagonal  blocks  to  arbitrary  neighborhood  of  the  zero  matrix,  the 
inevitable  results  is  the  appearance  of  large  gain  factors  in  the  control 
matrix  and  some  feedforward  links,  accompanied  with  negligible  entries  in 
the  output  matrix.  On  the  other  hand  when  there  exist  some  eigenvalues  of 
moduli  smaller  than  one  this  will  have  the  inevitable  result  of  the  appear- 
ance of  high  gains  in  the  output  matrix  of  the  resulting  GHR.  Thus,  the 
primary  aim  of  applying  the  generalized  QL  algorithm  is  to  detect  after  a 
relatively  small  number  of  iterations  whether  some  of  the  superdiagonal 
blocks  have  a high  rate  of  convergence  towards  a zero  matrix  such  that  by 
neglecting  them, an  acceptable  approximation  error  between  the  outputs  of  the 
full  order  model  and  the  outputs  of  the  approximate  model  in  which  such  terms 
have  been  neglected  is  acceptable. 

Assume  after  s iterations,  we  have  a new  GQL  processed  GHR 
representation : 
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z m F z + G u 
s s s s 

ym  ■ tu^£1>j'1ti1  o 


0]  Z 


(3.51a) 

(3.51b) 


with 


F5 

o 

Ej 

o 

(VI 

F * 
s 

a 

S 

a 

G = 
s 

a 

W 

z 3 
s 

s 

) 

p = 

j 

E r,  . 

i-1  1 


5 i 

If  superdiagonal  block  F.  ,+j  in  Eg  is  appreciably  reduced,  a candidate 
reduced  order  model  is  obtained  by  placing  = 0 and  thus  has  the  following 


form: 


G^u 


z * rzr  + 
r s r s 


y = 0 ...  0]  z 

m s-  i 1 r 


(3.52) 


which  results  from  retaining  only  the  strongly  observable  part  of  the 
resulting  system.  (3.52)  may  be  considered  as  an  approximate  aggregate 
model  of  (2.9).  A desirable  feature  of  (3.52)  is  that  (a)  approximate  output 

A 

ym  is  only  a linear  combination  of  measured  output  y^;  (b)  the  aggregated 

reduced  order  model  state  z r is  linearly  related  to  the  original  system  state 

x of  (2.9).  This  is  so  because  zg  of  (3.51)  is  related  to  x by  a linear 

transformation  z * U Hx.  Such  a relation  is  particularly  useful  if  (3.52) 
s s 

is  used  to  design  feedback  control  laws  which  is  subsequently  applied  to 
(2.9). 


•.  . 


-T 


• r 
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CHAPTER  4 

GENERALIZED  HESSENBERG  REPRESENTATION  AND  REDUCED  ORDER  MODELING 

Given  a large  scale  dynamic  system  with  many  variables,  one  is 
frequently  interested  in  the  behavior  and  control  of  only  a specific  subset 
of  variables.  Thus  a gross  or  aggregated  input-output  relation  that  does 
not  involve  details  of  unconcerned  internal  variables  is  of  interest.  A 
reduced  order  model  that  models  the  dynamics  of  these  variables  with 
acceptable  approximation  error  is  frequently  sufficient.  In  this  chapter, 
we  shall  study  how  GHR  may  be  used  for  the  construction  of  such  a reduced 
order  model  induced  by  a set  of  variables  (outputs  are  assumed)  and  show 
how  the  GQL  algorithm  can  be  used  to  combine  structural  information  and 
weak  coupling  in  order  to  achieve  approximate  aggregation.  In  the  most 
general  case,  crucial  steps  in  the  construction  of  a reduced  order  model 
via  GHR  involves  the  definition  of  the  model  structure,  the  selection  of 
adjustable  parameters  within  the  defined  structure  and  the  adjustment  of 
these  parameters  to  some  appropriate  values.  We  shall  show  that  the  GHR 
is  a useful  representation  of  a linear  system  for  the  purpose  of  constructing 
a reduced  order  model  because  it  determines  a collection  of  candidate 
structures,  and,  in  each  case,  singles  out  parameters  most  appropriate  for 
further  adjustment  if  this  is  necessary.  We  establish  these  assertions  by 
showing  how  some  existing  model  reduction  methods  when  applied  to  a system 
in  GHR,  only  adjust  a subset  of  GHR  parameters  within  the  selected  reduced 
order  model  structure. 

In  this  chapter  we  concentrate  on  the  case  where  (2.9)  is 
observable,  thus  not  aggregable.  In  this  case  Vi-  Recall  the 


78 


definition  of  aggregate  and  residual  subsystem  introduced  in  Chapter  2, 
i.e.,  equations  (2 .21)- (2 .23)  where 


_ 
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(4.1) 


and 


Aggregate  S : 
Residual  SL: 


.i 

i i 

i— i 

i 

z 

= F z 

+ 

E z 

+ 

G u 

±1 

i i 

_i_L 

— i 

z 

= H z 

+ 

F z 

+ 

G u. 

(4.2a) 

(4.2b) 


In  general  if  for  some  i,  the  norm  j| H 1 is  much  smaller  than  the  norms  of 
'f^I,  He1!!,  IIf1'!  , ||  G^||  , and  ||Gi|| , then  i+1  may  be  neglected  to  achieve 
approximate  aggregation  induced  by  (A,C).  The  resulting  reduced  order 
model  is 

z = Fiz  + GLu  , z € RP,  p»  Er  (4.3a) 

j=l  J 


y = L 0 ...  0]  z , y € R . 


(4.3b) 


On  the  other  hand,  if  none  of  the  Hessenberg  block  F^  i+1  can  be  neglected 
after  some  analysis  such  as  trajectory  error  growth  or  eigenvalue  perturba- 
tion, we  propose  that  an  approximate  reduced  order  model  be  constructed  in 
the  form: 

£ ~i ~ ~i 

(4.4) 


~ ~t~  . ~i 

z * F z + G u 


y = [ I 0 ...  0]  z. 
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for  some  i = l,...,k-l.  Here,  FL  and  G1  have  the  same  structure  as  F1  and 
G'*'  in  (4.1)  except  that  some  parameters  in  F*  and  G^-  are  to  be  adjusted 
to  more  appropriate  values  to  compensate  for  the  effect  of  the  neglected 
term  Ftfi+1zi+1. 

A natural  choice  is  to  adjust  only  the  subset  of  the  model 


parameters  in  F.  j=l,...,i,  and  in  G.  to  achieve 
1 , j l 


i - - i+1 

S F.  . z . + G.  u £ F . . z . + G.  u 
j=l  i.j  j L j=l  i,J  J i 


(4-5) 


and  effecitvely  compensate  for  the  effect  of  the  neglected  term  F^ 

This  is  indeed  what  results  when  singular  perturbation  theory  [20]  is 
applicable  for  the  decomposition  of  slow  and  fast  phenomena;  when  the 
procedure  of  norm-minimization  proposed  in  [2]  is  generalized  in  con- 
junction with  chained  aggregation;  and  when  an  approach  based  on  transforming 
the  reduced  order  modeling  problem  to  a constrained  regulator  problem  [43] 
is  developed.  We  first  show  when  each  of  the  above  methods  is  used  on  a 
system  in  GHR,  what  and  how  parameters  are  adjusted  so  that  (4.5)  is 
approximated.  The  drawbacks  of  these  methods  then  motivates  our  major 
proposal,  the  restricted  QL  algorithm.  The  remaining  sections  are 
organized  as  follows.  The  use  of  GHR  with  singular  perturbation  method 
is  presented  in  Section  4.1,  model  reduction  by  norm  minimization  is 
presented  in  Section  4.2,  while  model  reduction  using  GHR  formulated  as  an 
output  regulator  problem  is  presented  in  Section  4.3.  Finally,  we  proceed 
to  develop  the  RQL  algorithm  which  effectively  modifies  only  a subset  of 
model  parameters  while  retaining  the  general  structure  of  an  appropriate 
reduced  order  model  based  on  the  properties  of  the  generalized  QL  algorithm. 
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4.1.  GHR  and  Model  Reduction  by  Singular  Perturbation 

We  now  analyze  what  is  the  meaning  of  applying  singular  pertur- 
bation to  a GHR  in  terms  of  parameter  adjustment  in  the  slow  subsystem. 
Assume  the  existence  of  wide  separation  in  eigenvalue  modulus  in  (2.9).  It 
has  been  pointed  out  that  the  system  may  not  be  in  the  suitable  form  for 
singular  perturbation  analysis  and  how  GHR  and  GQL  methods  may  be  used  to 
bring  a general  system  into  the  suitable  form.  Assume  a GQL  processed  GHR 
already  exhibits  an  eigenvalue  separation,  i.e.,  the  dominant  eigenvalues 
are  approximately  specified  by  F1  and  the  fast  eigenvalues  are  approximately 
those  of  F for  some  index  i.  Then  to  obtain  the  singular  perturbation 
system  (3.50),  we  normalize  the  residual  subsystem  by  dividing  the  equation 
of  the  residual  in  (4.2)  by  and  introducing  the  notation  F*  = ■ . 

~i  H1  -i  1 M 

H = — r~  , G = ; — 5—  and  y,  = — — , the  composite  system  is  brought  to  the 

!!f  I!  !!f  |!  \\t\\ 

form: 


i i i _i  i 
z = F z + Eiz  + G u 

•id.  ~ i ~ _i  ~i 
p.z  = + Ftz  + G u. 


(4.6) 


Under  appropriate  conditions,  the  reduced  order  model  is  obtained  by  placing 
ji  = 0 and  solving  the  fast  subsystem  for  and  substituting  z1  into  the 
aggregate.  The  reduced  order  model  then  is 


(Fi-E1(F1)"1Hi)z1  + (Gi-E1(F1)'1G1)u 


y = [I1  0 ...  0]  z 


(4.7a) 


(4.7b) 


Considering  the  expression  for  E in  (4.1)  we  find  that  the  correction  terms 
E (F  ) and  E^fF*)  ^G^  have  the  structure 
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e^fVV 


Ki,l  Ki,2 


, Ei(F1)'1Gi  = ' • (4.8) 


Thus,  the  effect  of  applying  singular  perturbation  to  a system  in  the  GHR 

is  equivalent  to  modifying  only  the  parameters  in  F.  j = l,...,i,  and  G. 

1 > J 1 

in  the  GHR  according  to  (4.7a). 


4.2.  GHR  and  Model  Reduction  by  Norm-Minimization 

It  was  suggested  in  [1,10,13]  that  when  the  pair  (A,C ) is  not 
completely  aggregable,  the  dynamics  of  the  aggregated  state  variables  can 
be  approximated  with  a low  order  system  in  which  F is  selected  to  minimize 


the  norm  of  CA-FC.  The  norm-minimizing  F is  given  by 

T T - 1 
F = CAC  (CC  ) 

and  the  reduced  order  model  is 


(4.9) 


y = Fy  + CBu . 


(4.10) 


A basic  shortcoming  of  this  procedure  is  that  the  reduced  order  model  is 

restricted  to  be  of  the  same  dimension  as  the  measured  output  if  the  output 

matrix  C is  used  as  an  aggregation  matrix.  However,  with  the  introduction 

of  chained  aggregation,  this  approach  may  be  generalized  to  produce  reduced 

i 

order  models  of  dimension  p^,  i = l,...,k-l,  where  p^=.E^rj.  Suppose  a 
model  of  dimension  p,  is  desired.  Consider  that  the  system  has  been  trans- 
formed after  (i-1)  step  of  chained  aggregation  into  the  form  where  S'*-  ^ is 
in  GHR  while  S*  ^ as  yet  is  not.  Continuing  with  chained  aggregation  would 
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eventually  yield  the  GHR  as  in  (2.10). 
results  in  the  system  representation 


*1 

?1  > 1 

Fl,2_  0 

: 

£i-2 

s 

Fi-2,1 

Fi-2 , i-1 

Vi 

Fi-l,l 

i-1 , i-1 

X 

L r 

E 

However,  stopping  at  step  (i-1) 


(4 . .!  1 


Instead  of  continuing  with  step  i of  the  chained  aggregation  procedure  on 
the  residual  subsystem 

x^  = Ax^.  + Ez^  ^ + Bu  (4.12a) 

z.  = Ocr  (4.12b) 

we  shall  choose  a matrix  F such  that  !!cA-Fc!|  is  minimized  in  accordance 
with  (4.9).  The  approximately  aggregated  residual  subsystem  (4.12)  thus 
becomes 

z.  = Fz.  + CEz1’1  + CBu  (4.13) 

T --T  -1  i-1 

where  F = CAC  (CC  ) and  z , consistent  with  the  notations  given  in  (4.1), 
is  the  composition  of  the  subvectors  z y j = 1 ,2 , . . . , i- 1 . Subsystem  (4.13) 
coupled  with  the  existing  aggregate  S1  1 at  step  i-1  of  chained  aggregation 
comprises  a corrected  reduced  order  model.  Comparing  the  effects  of  norm- 
minimization  characterized  by  (4. 12 ) - (4 . 13 ) with  the  model  Si  obtained 
directly  from  GHR  by  neglecting  E* , it  follows  immediately  that  the  resulting 
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model  will  have  the  form  (4.4)  with  F.  .,  j-l,...,i-l  and  G.  the  same  as 

^ > J 1 


those  in  the  complete  GHR,  Vi,  while  F.  . is  adjusted  to  a new  value  given 
by 


T --T  -1 

F.  . = CAC  (CC  ) . 

1 J 1 


(4.14) 


Thus,  the  effect  of  using  norm-minimizing  at  step  i is  equivalent  to 

adjusting  only  the  parameters  F.  . in  the  complete  GHR. 

i i 1 


4.3.  GHR  and  Model  Reduction  by  Optimal  Output  Regulator  Design 

In  this  section,  the  model  parameter  adjustment  will  be  carried 
out  using  the  optimization  procedure.  Unlike  [19]  where  all  reduced  order 
model  parameters  are  obtained  through  optimization,  the  proposed  approach 
adjusts  only  a subset  of  parameters  within  the  chosen  GHR  structure,  namely 


blocks  F^ , j = l,...,i.  Assume  a model  of  the  form  (4.4)  is  sought.  Let 


us  consider  only  open-loop  behavior  of  the  system  and  its  reduced  order 


model.  In  terms  of  (4.5),  the  adjustment  on  blocks  F^ ^ , j*l,2,...,i  is  to 


find 


5F.  . , j * 1, . . . ,i  such  that  ;,F.  ,,.z.  „ • ZfiF.  .z  . is  minimized,  i.e 
ij  J 1 i,i+l  i+l  j=i  ij  j 


F.  . ,.Z.  J,  as  I SF.  .2.. 
i , i+l  1+1  j=l  IJ  J 


(4.15) 


Clearly  complete  compensation  cannot  be  achieved,  i.e.  equality  cannot  hold 
for  (4.15).  In  the  sequel,  we  shall  see  how  the  problem  may  be  reformula:- 
as  an  optimal  output  regulator  problem  and  that  (4  15)  be  solved  bv  a; 
additional  feedback  such  that  F of  (4.4)  is  obtained. 


i , i+l 


Let 
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the  reduced  order  modeling  problem  by  parameter  optimization  may  be  refor- 
mulated in  the  following  way:  Given  the  augmented  system 


w = F w + Dv 

z1  = FV  + E^ 
F » H^1  + F^1 


(4.17) 


determine  the  "control"  v of  the  form 


v - -Kw 


so  that  the  following  quadratic  criterion  is  minimized: 

GO 

J(w  ,zi,z^,K)  a if  [ (w-zi)T(w-z1)  + v^TRvJdt. 


(4.18) 


Introducing  the  notation 


E1  , B 


0 , Q 


(4.19) 


C - 11  0 0] 


the  problem  reduces  to  the  following: 


z = Ax  + Bv 


y ■ Cx 


(4.20) 


J - % J*  (xTQx+vTRv)dt 


Because  v - -Kw  ■ -Ky.  (4.20)  becomes  a constrained  output  regulator  problem 
[43]  which  has  an  optimal  linear  feedback  solution  dependent  on  the  initial 
condition  of  state  x.  The  optimal  feedback  gain  K is  obtained  by  reformu- 
lating (4.20)  as  a parameter  optimization  problem  where 


i 
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Then 

T IT 
E<*o  V ' n""  • 

Consequently  the  necessary  conditions  (4.22)  for  optimal  K becomes: 


(4.25) 


(A-BKC)TM  + M(A-BKC)  + cVlRKC  + Q - 0 (4.26a) 
N(A-BKC)T  + (A-BKC)N  + ^tt  nT  - 0 (4.26b) 
K - R*1BTMNCT(CNCT)'1.  (4.26c) 


Thus,  the  original  parameter  optimization  problem  has  been  reduced  to  a 
problem  of  determining  the  triplet  (M,N,K)  as  the  solution  of  a set  of 
coupled  algebraic  matrix  equations.  While  the  conditions  under  which 
convergence  to  a solution  with  different  iteration  schemes  are  known  [43,44], 
it  is  difficult  to  satisfy  them.  In  particular,  if  for  some  K*^,  (4.26a) 
is  solved  for  and  given  K^,^,  (4.26b)  is  solved  for  and  the  pair 
M^,N^  is  used  in  (4.26c)  to  obtain  the  successive  it  has  been  shown 

that  the  scheme  will  converge  to  a solution  if  at  every  step  A-BK^C  is  a 
stable  matrix.  However,  there  is  no  guarantee  that  generated  through 
this  procedure  will  be  stabilizing.  Nevertheless  this  as  well  as  modified 
schemes,  have  been  found  applicable  in  practice. 

To  solve  the  reduced  order  modeling  problem  by  transforming  it  into 
an  equivalent  output  regulator  problem,  it  is  therefore  necessary  to  solve 
two  Lyapunov  equations  of  order  n,  TT^n+p^  and  compute  the  PjXpj^mmatrix  K. 
However,  from  the  structure  of  the  equivalent  system  and  the  defined 
criterion,  (4.19)-(4.20),  it  may  be  shown  that  if  the  resulting  average 
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0 


i 


value  of  J is  not  of  interest  (which  it  might  be  for  possible  comparison  of 
two  different  reduced  order  models)  it  is  actually  only  necessary  to  solve 
two,  non-square  linear  matrix  equations  of  order  p^Xfa+p^).  To  see  this 
decompose  M and  N as 


M - [Mj  Kj] 


_M11 

M12 

M13~ 

'Nll 

N12 

N13 

T 

M12 

”22 

“23 

, N = [Nx  N2  N3J  = 

T 

i2 

N22 

N23 

T 

(_M13 

T 

“23 

“33_ 

T 

_N13 

T 

N23 

N33_ 

Equation  (4.26c)  then  takes  the  form 

K 

Equations  (4.26a)  in  expanded  form  become: 


-IT  T 
R DM^. 


(Fi-DK)TM11  + Mu(Fi-DK)  + I + KTRK  - 0 


(Fi-DK)TM12  + M12Fi  + M13E1  -1  = 0 
(F1-DK)TM13  + M^H1  + K13Fi  - 0 


1*  i^  T i i 

F1  + E M£3  + M^F  + M^E  + I 

f1\3  + E,M33  + "22Hl  + «23F 

iT  iT  T i — i 

H M23  + F + M^3H  + Mj3F 


—i 


while  (4.26b)  becomes: 


N11(F1-DK)X  + (F1-DK)Nn  + £ I = 0 

iT  ,T  i i 

N12F  + N13fii  + (F  _DK>N12  + ^ 1 * 0 

T T 

N12h1  + N13Fi  + <F  "dk)n13  " 0 
,T  jT 


n22f 


iA  i*  i 

JL  %1  • — 


♦ V 


* F'K22  + *22  + n 1 


N^H1  + N^F1  + F1N23  + E1N33 
t T .T 


+ NjjF1  + H1^,  + f\3  + i I 


.T  .Jij 


(4.27) 


(4.28) 


(4.29) 


(4.30) 

(4.30) 


[ 
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Thus,  we  find  that  (4.28),  (4.29a)- (4 .29c) , and  (4.30a)-(4.30c)  are 

decoupled  from  the  remaining  equations  and  thus  that  the  desired  gain  matrix 

K may  be  obtained  by  solving  only  this  restricted  set  of  coupled  equations: 

-IT  T 
K - R D MjMj 

N.AT  + (F1-DK)N1  + - P « 0,  P - [I  0 0]  (4.31) 

i in 

(Fi-DK)TM1  + MjA  + P ■*  0. 

When  K*  is  obtained,  the  reduced  order  model  of  the  system  is  characterized 
by 

F1  - F*-DK*  * Fi-DR'1DTI^N*  (4.3?) 

and  the  expected  values  of  J is 

2 2 

3 - £ Trac.  + M33].  (4.33) 

Of  course,  in  the  actual  solution  of  (4.31),  the  fact  that  (4.29a)  is 
decoupled  from  (4.29b),  (4.29c),  and  that  (4.30a)  is  decoupled  from  (4.30b), 
(4.30c)  can  be  utilized. 


4.4.  GHR  and  Model  Reduction  by  the  Restricted  QL  Algorithm 

From  previous  sections  we  have  demonstrated  how  existing  model 
reduction  techniques  may  be  adapted  and  applied  for  constructing  reduced 
order  models.  Two  particular  features  of  the  modeling  procedure  should  be 
noted:  (a)  the  utilization  of  the  GHR  structure  and  (b)  the  adjustment  of 

only  a subset  of  parameters  through  a well-defined  procedure.  Nevertheless, 
each  approach  possesses  certain  drawbacks.  Singular  perturbation  is  only 
applicable  when  two-time  scale  property  exists;  norm  minimization  is  not 


invariant  with  respect  to  system  representations  and  finally  output 
regulator  formulation  cannot  guarantee  existence  and  uniqueness  of  solutions 
to  (4.22). 


0 

II 

0 


We  now  present  a general  method  based  on  the  GQL  theory  developed 

in  Chapter  3.  The  approach  taken  here  is  to:  (I)  transform  (2.9)  into 

its  GHR  by  chained  aggregation;  (II)  choose  a particular  decomposition  into 
i _i  * 

S and  S based  on  structural  considerations  ; (III)  apply  the  GQL  algorithm 
_i-l 

to  the  residual  S ; (IV)  construction  of  reduced  order  model  by  combining 

i-1  -si-1 

S and  the  reduced  equivalent  of  s that  exhibits  the  dominant  dynamics  in 


Consider  a GHR  of  a LTI  system  and  assume  that  based  on  the 
internal  structure  of  the  GHR,  plausible  model  may  have  dimension 
Pi  “ r^  + • • • +ri,  where  r ^ , j*l,...,i  is  the  dimension  of  through  in 
the  GHR.  Then  for  a model  of  dimension  p^,  the  plant  matrix  F*-  and  the 
control  matrix  G*  are  then  seen  as  rational  initial  guesses  in  the  construc- 
tion of  a reduced  order  model.  We  propose  here  that  the  interaction  term 
should  be  compensated  and  that  this  generally  be  accomplished  by  the 
adjustment  of  some  parameters  in  F*  and  G1"  when  the  Interaction  term  is 
dropped.  We  now  describe  how  the  selection  of  parameters  to  be  adjusted  and 
the  subsequent  adjustment  of  these  parameters  can  be  achieved  methodologically 
by  applying  the  restricted  QL  algorithm. 


By  structural  considerations,  we  mean  tests  for  controllability 
and  observability;  trajectory  and  eigenvalue  perturbation  analysis,  etc. 
selection  of  reduced  order  model  order  may  also  be  carried  out  as  described 
in  [45-46J . 
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Decompose  the  plant  matrix  F as 

[f1"1  . L Bx 

F - I , , I |iF,.  (4.34) 

Note  that  from  the  introduced  notation  the  following  relation  holds  between 

„i  , i-1 

F and  F : 


.i-1 


ri-l,i 


Fi,l’ ‘ ,Fi,i-l  I Fi,i 


(4.35) 


It  also  follows  that: 


B1  ’ 


LFi-l,i 


0 

0 

0 

0 


(4.36) 


and  that  F^  ^,...,Fi  in  (4.35)  are  the  top  layer  blocks  in  C^,  while  F^^  ^ 
is  the  upper-left  corner  block  matrix  of  . 

Define  now  the  similarity  transformation 


T - 


I 0 
0 L 

the  block-partition  of  T being  compatible  with  (4.34)  and  define  L such  that 
it  achieves  the  generalized  QL  decomposition  of  D^,  i.e. 

Dx  - QL 

for  some  unitary  matrix  Q.  It  is  immediately  clear  from  the  properties  of 


' '-K  • 

3 , 4 . ’.Jf  * n , 
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the  generalized  QL  algorithm  that  this  transformation  achieves  the  following: 
(i)  T defines  a similarity  transformation  and  thus  all  eigenvalues 
of  F are  preserved 

(ii)  L defines  a QL  decomposition  of  and  thus  all  eigenvalues 
of  are  preserved. 

Consider  now  a sequence  of  iterations  such  that  in  the  k-th  iterate  we  have 


*k  \ 

°k  °k 


I 0 
0 ^ 


* °k  " Vv 


(4.37) 


-1 


Then,  since  Fk+1  ■ TkFkTk  we  have 


k+1 


\ 

h.%  w;1 


°k+i 


r°r 

vT 


(4.38) 


Thus  after  a number  of  iterations  we  observe  that  letting  L = 
the  following  can  be  concluded: 

~i“l  . , 


(a) 

**  A^  * F*  ^ and  thus 

(b) 

Bk+^  * B^L  ^ . Because  of 

(c) 

P 

* LC^  and  thus  the  bli 

adjusted; 

(<*) 

Dj^  ■ LD^L  ^ and  thus  F^ 

been  adjusted; 

r (e) 

The  block  F^  i+1  next  to  F. 

(f) 

p 

The  eigenvalues  of  have 

.. 

(g) 

dominant  eigenvalues  of 

i-1  i-1 

* Gj  and  thus  , 

ii’ 
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GO  ^+1  ■ ^ and  thus  has  been  adjusted. 

Therefore,  if  based  on  the  structural  properties  of  the  GHR  and 

the  physical  insight  concerning  the  system  being  considered,  it  is  decided 

that  a reduced  order  model  containing  the  first  i layers  of  the  GHR  should 

be  used  as  the  basis  for  constructing  a reduced  order  model  of  dimension  p^, 

then  the  restricted  QL  algorithm  provides  a methodological  way  for  modifying 

those  parameters  of  the  model  contained  in  the  blocks  F.  . . , F.  ., 

i-i , l i , J 

J"l,...,i  and  G^.  The  final  result  obtained  by  neglecting  F^  in  the 
resulting  RQL  processed  GHR  is  a model  characterized  by  the  following  plant: 
and  control  matrices: 


Fl,l  Fl,2  '**  0 0 

l 

r— 1 

e> 

i 

~i 

F2,l  F2,2  •••  ° 0 

G2 

F * 

• • • 

• • • 

• • • 

Fi-l,l  Fi-1,2  Fi-l,i-l  Fi-l,i 

, G = 

Gi-1 

_Fi,i  Fi,2  Fi, i-1  Fi,i 

_Gi  - 

where  the  result  may  be  interpreted  as  if  the  coupling  term  Fj^  i+^zi+1  has 
been  approximated  via  a linear  combination 

i 

Fi,i+lZi+l  **  j-l^i,j'Fi,j)zj  + ^i-Gi)u 
with  additional  adjustment  of  the  parameters  in  the  block  F^  ^ 

The  effect  of  applying  the  described  method  to  construct  a reduced 
order  model  can  best  be  interpreted  in  the  concept  of  dynamic  equivalents 
of  external  system  often  used  in  power  systems  [47]  and  model  reduction 
philosophy  in  general.  From  (4.37)  and  the  form  of  T^,  we  note  the  RQL 
algorithm  in  effect  applies  only  the  generalized  QL  transformations  to  the 
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residual  subsystem  By  virtue  of  Theorem  3.6,  the  net  effect  is  the 

shifting  of  the  dominant  dynamics  in  the  residual  towards  leading  sub- 
matrices in  . Thus  the  leading  subsystem  in  the  residual  represents  a 
reduced  equivalent  of  the  residual.  Specifically,  suppose  that  a decom- 
position has  been  made  and  (F^  defines  a desired  but  fixed  internal 

subsystem  while  (F  characterizes  the  external  subsystem  with 

F^_^  izi  serving  as  a coupling  between  the  two.  This  is  illustrated  in 
Fig.  4.1.  Applying  the  RQL  iterations  to  system  of  Fig.  4.1,  this  amounts 
to  obtaining  an  equivalent  of  the  external  subsystem  £3*  1 and  replacing  ^ 
by  its  dominant  approximate  (order  r^<n-p^  _^)  after  a finite  number  of  RQL 
iterations.  This  is  shown  in  Fig.  4.2.  The  reduced  order  model  is  then  the 
composition  of  the  untouched  internal  subsystem  plus  the  newly  obtained 
dynamic  equivalent  of  the  residual,  Fig.  4.3.  As  seen  from  (4.39),  the 
internal  model  of  the  system  remains  unaffected  by  the  equivalencing 
procedure,  while  the  interconnections  and  the  model  of  the  equivalent  have 
been  adjusted  and  constructed,  respectively. 

The  procedure  is  therefore  intuitively  appealing  and  provides  a 
result  that  is  desirable,  and  in  fact,  is  often  pursued  in  practical 
applications.  The  procedure  however,  seems  to  provide  more  than  is  usually 
obtainable  by  existing  methods.  First,  there  is  a rational  choice  available 
concerning  the  dimension  of  the  model,  and  in  fact  a collection  of  reduced 
order  models  of  various  system  order.  Second,  most  of  the  model  parameters 
do  not  need  to  be  adjusted  (at  least  in  principle)  and  while  the  adjustment 
of  those  that  do  have  to  be  modified  is  done  in  a straightforward  and  well- 
defined  manner.  Moreover,  the  parameter  adjustment  procedure  has  an 
appealing  interpretation  in  terms  of  interconnections,  equivalents  and 


i 


9. 


Figure  4.2.  Construction  of  reduced  order  model  by  RQL  algorithm 


Reduced  Order 
Model:  Sl-10Sj 


Effective  reduced  order  model  of  the  large  scale 
system  via  RQL  algorithm. 


r 
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reduced  order  model.  And  finally  in  this  reduced  order  modeling  procedure 
not  only  do  we  define  precisely  the  equivalent  of  a system  interconnected  to 
another  system,  but  also  in  the  process  of  obtaining  it  we  are  not  forced  to 
make  any  assumptions  concerning  the  control  efforts  appearing  in  the  external 
system.  The  control  variables  are  not  lost  in  the  equivalent  as  is  the  case 
in  all  other  equivalencing  procedures  known  to  us,  but  remain  present  in  the 
reduced  order  model.  The  effect  of  applying  RQL  algorithm  to  a GHR  for  the 
construction  of  reduced  order  model  will  be  studied  via  examples  in  Chapter  6 
while  the  application  of  other  methods  will  be  subject  to  further  investiga- 
tion and  will  be  reported  elsewhere.  As  a remark,  we  believe  there  is  a close 
connection  between  order  reduction  and  weak  observability.  Recently  Moore  has- 
used  singular  value  decomposition  to  quantify  weak  observability  [68-69]. 
However  such  results  appeared  late  in  the  research  stage  and  are  not  studied 
in  this  thesis. 

4.5.  Robustness  of  Reduced  Order  Model  for  Control  Design  - A Stability 
Analysis 

One  of  the  fundamental  purposes  in  constructing  reduced  order 
models  arises  from  the  need  for  such  models  in  various  synthesis  or  control 
problems.  Although  a control  design  based  on  a reduced  order  model  may  be 
satisfactory  when  applied  to  the  reduced  model,  e.g.  stabilizes  the  closed- 
loop  reduced  order  model,  it  is  possible  that  when  such  a control  is  applied 
to  the  full  order  actual  system,  the  performance  is  not  satisfactory,  e.g. 
the  system  becomes  unstable.  Thus  a basic  test  of  validity  of  the  reduced 
order  model  for  control  design  can  be  assessed  in  terms  of  stability 
properties.  Other  criteria  may  be  related  to  suboptimality  of  cost  functions 
if  optimization  is  important.  We  will  only  consider  the  stability  question 
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in  this  thesis.  Sufficient  conditions  for  a control  strategy  selected  using 
the  reduced  order  model  to  stabilize  the  actual  system  are  derived.  Two 
different  approaches  are  taken.  In  the  first,  stability  is  guaranteed  using 
Lyapunov  functions  and  bounds  on  system  matrix  perturbations.  In  the  second, 
a frequency  domain  approach  is  adopted. 


4.5.1 . Problem  Statement 


Consider  the  GHR  of  (2.9)  arbitrarily  decomposed  into  S'*-  and  sS 


r.il 

r _i 

i" 

i' 

r i- 

z 

F 

E 

z 

+ 

G 

iS 

„i 

-i 

_i 

-i 

z 

H 

F 

z 

G 

(4.40a) 


[D1  0] 


(4.40b) 


T _T  T _i 

where  z = [T*  T ] x.  Assume  F is  stable.  Let  the  approximate  aggregated 


model  of  (2.9)  be 


zr  = F1zr  + Giu 
* 

y = D zr. 


Suppose  the  control  law 


u = Kz 


(4.41a) 

(4.41b) 

(4.42) 


is  designed  based  on  (4.41)  and  stabilizes  (4.41).  Furthermore,  suppose  in 
controlling  (2.9)  (equivalently  (4.40)),  the  control  (4.42)  is  implemented  as 


u = Kz  = KTrx. 


(4.43) 

Then  the  problem  is  to  obtain  conditions  under  which  stability  is  preserved 
for  the  closed  loop  system 


' = (A+BKTr)x. 


x 


(4.44) 
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4.5.2.  A Stability  Condition  Via  Perturbation  Analysis 

Since  stability  is  invariant  to  linear  transformations,  then 
stability  of  (4.44)  is  equivalent  to  the  stability  of 

r zl  1 I Fi+GiK  Ei_l  f Z1! 


’ .11 

z 

jJL 

z 

- 

L 

Hi+G1K  Fd  z* 


(4.45) 


Introduce  the  notation 

0 

C H1+G1K  F1 


0 E 

0 0 


(4.46) 


By  assumption,  (F  +G  K)  is  stable  because  (4.42)  stabilizes  (4.41).  Since 
F is  also  stable,  then  there  exists  a positive  definite  and  symmetric  matrix 
P such  that 

PFc  + F^P  = -Q  (4.47) 

where  Q is  any  positive  definite  and  symmetric  matrix. 

Let 

v * zrz  (4.48) 

be  a possible  Lyapunov  function  for  (4.45).  The  objective  is  to  bound  AF 
such  that  v>0  and  v<0  when  evaluated  along  (4.45). 

Definition  4.1:  The  control  law  (4.43)  is  said  to  be  robust  if  stability 
of  (Fi+GiK)  implies  (4.44)  is  stable. 

Let  || 'll  denote  the  Euclidean  norm^  and  ^min(A),  X^^A)  denote  the 
minimum  and  maximum  eigenvalues  of  A respectively.  Furthermore,  for  a given 


x _ 

The  term  robustness  has  been  defined  elsewhere  [61,62]  to  mean 
stability  or  system  structural  properties  under  parameter  variations. 

^Given  a nXm  matrix  K,  the  Euclidean  norm,  ]|k||  is  defined  as 
IIk||  * ^i^i  jSjkij!2^  while  the  spectral  norm  HKHS  a tX^^ (KKT)}^. 


» fi^r 
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Q>0,  let  P be  defined  by  (4.47).  Then  Theorem  4.1  gives  sufficient 
conditions  for  control  (4.43)  to  be  robust  in  terms  of  the  norm  of  pertur- 
bation AF.  The  proof  is  given  in  Appendix  C. 

Theorem  4.1:  The  control  law  (4.43)  is  robust  if  the  neglected  Hessenberg 
block  is  such  that 

X . (Q) 

IMI  <L  % • (4.49) 

max'  J 

We  close  this  section  by  noting  the  sufficient  condition  (4.49)  is 
very  easy  to  check.  Due  to  the  block  triangular  structure  of  F£,  P may  be 
solved  for  using  lower  order  calculations. 

4.5.3.  A Stability  Condition  Via  Frequency  Domain  Analysis 

In  this  section,  an  alternative  approach  is  taken  to  examine 
stability  of  (4.44).  The  method  developed  in  Section  4.5.2  can  be  conser- 
vative due  to  the  use  of  matrix  norms.  The  frequency,  domain  method  developed 
here  offers  additional  insights  without  introducing  such  matrix  boundings . 

Since  (4.42)  stabilizes  the  reduced  order  model  (4.41),  then  for 
any  Q>0  (>0  means  positive  definite  and  symmetric)  there  exists  a P>0 
such  that 

P(Fi+GiK)  + (Fi+G1K)TP  * -Q.  (4.50) 

Furthermore  (4.45)  still  holds.  Define  a Lyapunov  function  for  (4.45)  as 


where 


v • % zTKz 


(4.51) 

(4.52) 


and  M is  some  positive  definite  and  symmatric  matrix.  Then  differentiating 
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Identity  I: 


A(M) 


Identity  II: 


A(M) 


iT 

TT(M)  0 

I 0 

0 MF022  +Fq22M 

L1  l 

(4.60) 


(4.61) 


The  two  identities  may  be  easily  verified  using  the  definitions  (4.56)-(4.59) 
Due  to  the  identities,  we  have  the  following  theorem: 

Theorem  4.2:  The  following  conditions  are  equivalent 

(i)  A (M)  < 0 

(ii)  R (M)  < 0 and  -Q<0 

(iii)  tt  (M)  < 0 and  (MFQ22  + F^M)  < 0. 

Remark : An  interesting  observation  follows  from  Theorem  4.2.  If  indeed  a 
M>0  exists  such  that  A(M)<0,  (iii)  implies  the  existence  of  a Q>0  with 

MF022  +F022M  ’ (*•«) 
Since  (4.62)  is  a Lyapunov  equation,  fq22 S ^ must  be  stab^e*  Such  an 
implication  may  be  justified  as  follows.  If  is  neglected  and  (4.42) 

is  designed,  Sf*  is  uncontrollable.  Thus  the  stability  of  F*  is  not  unreason- 
able as  a requirement  in  order  for  (F,  +AF)  to  remain  stable  for  small 
perturbation  F^  i+^. 

Theorem  4.2  indicates  either  (ii)  or  (iii)  may  be  used  to  prove  (i) 
Without  loss  of  generality,  let  us  guarantee  (ii)  in  order  to  derive 
sufficient  conditions  for  the  existence  of  a M>0.  The  conditions  for 
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stability  are  summarized  in  Theorem  4.3.  The  details  of  the  proof  may  be 
found  in  Appendix  D. 

Theorem  4.3:  If 

(a)  (F,Fc2^)  is  comPletely  controllable  and  (F.E1-)  is  completely 
observable 

(b)  ReX  (F)  < 0 

(c)  I-Fj21(-ju)I-FT)‘1Q(J«)I-?)"1Fc21  >0  Yu 

where  hf1  + (H1 +GiR)PEi,  QSE^PPE1,  F^-^+gSc.  Then  the  control  law 
(4.43)  is  robust. 


7»T 
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CHAPTER  5 

GHR  AND  CONTROL  SYNTHESIS  BY  FEEDBACK  COMPENSATION 


Consider  a large  scale  interconnected  system 

xi  " Aiixi  + BiiUi  + + Eif 

(5.1a) 

(5.1b) 

y t * c^i  , i ■ l, . . . ,v 

(5.1c) 

ni  mi  ni  Yi 

where  xi  € r , u^  6 R , M>i  6 R , f€Rq,  and  y^  € R are 

subsystem  state, 

control,  interconnection,  disturbance,  and  output  variables  respectively. 

T t T 

Suppose  the  system  interconnection  y*[y^  ...  y^l  are  desired  to  track  the 

output  y of  a reference  system 

w'  = F^w'  + G’uq  + W'f 

(5.2a) 

y - D'w' 

(5.2b) 

u **  l'w ' 

0 

(5.2c) 

where  w'€rP,  uq  6 Rm,  m^E^ra^,  f€Rq,  y€RY,  are  ttle  reference 

system  state,  control,  disturbance  and  output  variables  respectively,  and 
uq  is  a fixed  reference  system  control.  This  chapter  considers  the  synthesis 
of  local  controls  u^  i"l,...,v  such  that 

e (t)  s y (t)  - y(t) 


approaches  zero  asymptotically.  Moreover,  u^  assumes  the  apriori  form 


ui  " TTiuio  + Kie  + Miixi 


(5.3) 


u * [uF  . . . u^  ] ^ 
o lo  VO 


. r T T,r 

, U ■ [Uj^  . . . t^J  . 


where 


(5.4) 
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Also  it  is  desired  to  obtain  (5.3)  without  excessive  information  transfer 
between  subsystems  and  parallel  computation  by  individual  subsystem  can  be 
achieved . 

Note  because  the  local  control  (5.3)  is  a function  of  composite 
error  e(t),  some  information  transfer  is  required  during  computation  and 
implementation.  We  propose  a hierarchical  structure  such  that  information 
coordination  and  decentralization  be  performed  by  a higher  level  coordinator. 
One  motivation  stems  from  the  structure  of  (5.1).  If  the  interconnection 
input  H ^ is  viewed  as  an  external  disturbance  and  its  dynamic  evolution  is 
known  to  each  subsystem,  then  the  computation  at  local  subsystem  level  can 
in  principle  be  carried  out  in  parallel  and  independent  of  other  subsystems. 

To  specify  the  interconnection  y^,  Vi,  we  propose  that  a coordinator  exists  at 
the  secondary  level  whose  main  concern  is  the  behavior  of  y^  according  to 
(5.2).  For  coordination  and  control  implementation,  the  coordinator  is 
assumed  to  be  in  constant  communication  with  the  subsystems  so  that  e(t)  is 
readily  computed  by  the  coordinator.  Functionally,  the  local  control  (5.3) 
is  a composite  of  the  coordinator  and  decentralized  subsystem  control.  The 
component  TTiu^0  and  K^e  are  supplied  by  the  coordinator  and  the  local  state 
feedback  M^x^  is  generated  locally  at  subsystem  level.  The  basic  configura- 
tion is  shown  in  Fig.  5.1. 

It  will  be  shown  subsequently  how  insights  gained  from  the  GHR 
structure  can  be  utilized  to  solve  the  above  synthesis  problem.  The  approach 
is  to  reformulate  the  reference  system  (5.2)  into  an  nth  order  reference 
system  (having  the  same  input-output  behavior  between  uq  and  y)  with  a 
structure  similar  to  the  GHR  of  the  composite  system  formed  by  subsystems  in 


i 
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(5.1).  The  role  of  the  coordinator  will  then  be  seen  to  coordinate  de- 
coupling of  the  composite  system  into  an  aggregate  and  a residual  subsystems 
via  local  state  feedback.  The  tracking  of  $ by  y is  obtained  by  first 
compensating  the  interaction  between  the  aggregate  and  the  resi- 

dual and  then  applying  the  necessary  output  following  controls.  We 
emphasize  the  key  feature  of  the  proposed  method  is  the  separate  control  of 
the  aggregate  and  the  residual  by  local  state  feedback  controls  once  de- 
coupling is  introduced.  We  will  proceed  to  show  when  this  decoupling  exists, 
the  local  control  (5.3)  can  be  decomposed  into  three  basic  components.  One 
component  provides  the  necessary  feedback  compensation  to  achieve  aggregabilil y 
and  decoupling.  The  second  serves  to  control  the  aggregate  and  the  third,  if 
exists,  represents  a freedom  in  control  to  shape  the  dynamics  of  the  residual. 

The  chapter  is  organized  as  follow.  In  Section  5.1,  the  synthesis 
problem  is  formulated  as  an  output  model  following  problem.  In  Section  5.2, 
perfect  output  following  is  defined  and  the  existence  and  properties  of  the 
local  controller  to  follow  a r^th  order  reference  system  are  examined. 

Section  5.3  extends  the  results  of  Section  5.2  to  a reference  system  of  order 
greater  than  r^.  Finally  a decomposed  design  strategy  is  investigated  in 
terms  of  the  hierarchy  introduced.  The  result  is  a precise  definition  of 
the  coordinator  and  the  subsystem  level  problems. 

5.1  Preliminaries 

i 

For  the  reference  system  (5.2),  we  assume  p * p * £ r where 

J-l 

r^  are  the  subsystem  dimensions  of  the  GHR  for  the  composite  system 
formed  by  (5.1).  Moreover,  for  the  reference  system  (5.2)  to  be  arbitrary, 
(F^,G')  is  assumed  to  be  controllable  so  that  arbitrary  dynamics  may  be 
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obtained  by  a suitable  reference  system  control  (5.2c).  (F^,D')  is  assumed 

to  be  observable  so  that  arbitrary  reference  dynamics  is  seen  as  arbitrary 
reference  output  y.  We  shall  also  assume  that  the  triplet  (F^,G',L') 
satisfies  (for  an  suitable  index  i) 

F1  + GiL  = (F^  + G'L' ) (5.5) 

for  some  matrix  L.  Here  (F^G*)  comes  from  the  aggregate  S*  of  the  GHR  of 
the  composite  formed  by  (5.1).  The  reason  for  such  an  assumption  is  that 
the  reference  interconnections  y should  be  obtained  from  a system  that 
exhibits  similar  behavior  between  u and  y from  an  input-output  point  of 
view,  thus  giving  a degree  of  mutual  harmony  between  y and  y.  Equation 
(5.5)  incorporates  this  reasoning  by  relating  the  reference  system  to  the 
aggregate  which  is  an  approximate  reduced  order  model  of  the  composite 
system.  For  simplicity,  let  F^-F*,  G'  * G*  in  (5.5)  and  D'  = D*-  in  (5.2). 
Finally,  we  assume  same  class  of  disturbance  acts  on  the  reference  system 
as  on  the  aggregate  S*  of  the  GHR  (5.8).  Thus  W'  = W*. 

The  interconnected  system  (5.1)  may  be  written  as  a composite 

system 


v 

x - Ax  + £ B u.  + E f (5.6a) 

i-1  1 * 


y = Cx 


(5.6b) 


where 


A 


v v 

xgRn,  n-  £ n. , y€RY,  V"  £ Y,  and 
i-1  1 i-1 


— 

" 

_ 

A11 

A12C2 

AlvCvv 

B11 
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• 
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\v 

B 

vv 

_ 

j 
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- [B1  ...  By] 
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'11  0 


(5.7) 


Using  the  chained  aggregation  procedure  of  Chapter  2,  (5.6)  may  be  equi- 
valently expressed  in  GHR  as 


z « Fz  + Gu  + Wf 


(5.8a) 


y ■ Dz 


(5.8b) 


where  F,  G and  D are  given  by  (2.11)  and 


W - HE  - [W*  ...  W^]T 


(5.9) 


H - [CT  ?]T 


(5.10) 


H being  the  generalized  Hessenberg  transformation  matrix  for  (5.6). 

Using  (5.5),  from  an  input-output  point  of  view,  the  reference 
system  (5.2)  may  be  realized  equivalently  as: 


w " F w + Gu  + Wf 
o o 


(5.11a) 


y ■ D W 


(5.11b) 


u ■ Lw 
o 


(5.11c) 


where  w ^ Rn  and  G,  W,  D are  same  as  in  (5.8)  except 


F1  0 


h1  F1 


(5.12) 
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Since  the  control  objective  is  the  regulation  of  e(t)  to  zero  and  y,  y 

being  outputs  of  (5.8)  and  (5.11)  respectively,  we  note  y can  follow  y if 

(5.8)  can  be  made  to  follow  the  reference  system  (5.11).  In  this  sense 

(5.8)  (or  equivalently  (5.6))  is  the  system  and  (5.11)  is  the  reference 

model.  A natural  approach  to  the  synthesis  of  (5.3)  is  a model  following 

design  [50-51].  Taking  advantage  of  the  GHR  structure  and  y,  y being 

the  first  subvector  of  z and  w respectively,  direct  results  on  the  existence 

of  (5.3)  can  be  obtained  if  we  define  the  output  error  e(t)  instead  of  the 

state  error  w(t)-z(t)  as  done  in  [50-51]. 

An  examination  of  (5.8)  and  (5.11)  indicates  y will  follow  y if 

j.  — i 

the  coupling  zi+l  between  S and  S may  be  compensated  by  a suitable 

local  control  (5.3)  and  the  substate  of  z and  w corresponding  to  F1  will 

track  each  other.  In  contrast  to  Section  4.3  where  the  coupling  is  approxi- 

i 

mated  by  feedback  from  the  states  of  the  aggregate,  i.e.  v=  £ 6 F.  . z 

J-l  1J  J 

such  that  l|Fi  ^+^z^+^  -v  il  is  minimized,  under  appropiate  conditions,  a 

complete  compensation  is  possible  by  feedback  from  the  residual.  Thus 

using  (5.5)>the  tracking  of  y and  y is  emphasized  in  terms  of  the  GHR  by 

i — i 

designing  (5.3)  to  decouple  S and  S as  an  initial  requirement  and  then 

achieving  some  sort  of  model  following  subsequently.  From  the  GHR  structure 

1 * —1 

given  in  (5.8),  we  note  that  for  S to  decouple  from  S , there  must 
exists  a residual  feedback  gain  K such  that 

F12Z2  = G1Kz2  (5,13) 

* i — ± 

Note  "decoupling"  used  here  means  S is  not  driven  by  S . In  general, 

i.  HL 

feedforward  exists  from  S to  S . 


r 
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Clearly  such  a K exists  if  and  only  if  (G^) . tae  °ther  hand 
when  (5.13)  is  not  satisfied,  it  is  not  sufficient  for  a gain  K to  exist 
such  that 


Fi,i+lZi+ 1 " GiKzi+l  * 1 > 1 


(5.14) 


in 


order  for  S*"  to  decouple  from  S*.  Because  if  ^ { G ^ } #0  , j < i,  then 


Gj  K zi+l  * 0 » j < i*  (5-15) 

i — • £ 

Thus  coupling  between  S and  S will  be  re-introduced  in  higher  level  sub- 
systems in  the  GHR. 

In  the  following  section,  the  model  output  following  problem 
defined  at  the  beginning  of  the  Chapter  will  be  examined  to  see  (I)  Under 
what  condition  a local  control  (5.3)  exists  such  that  decoupling  (achievement 
of  aggregability)  and  output  y following  y of  the  reference  system  can  be 
achieved?  (II)  What  is  the  implication  of  (5.3)  in  terms  of  decentralized 
control  and  parallel  computation  such  that  a separation  in  design  may  be 
carried  out?  and  (III)  Is  there  additional  freedom  in  control  synthesis 
beyond  achievement  of  aggregability  and  output  following,  and  can  it  be 
used  to  shape  the  dynamics  of  the  residual  subsystem? 

5.2  Complete  Aggregability  and  Perfect  Output  Following  by  Local  State 
Feedback 

This  section  considers  a reference  system  of  dimension  p*r^. 

From  Section  5.1,  the  problem  is  expressed  as  to  investigate  the  possibility 
of  compensating  the  coupling  F^z2  at  the  first  GHR  layer  and  then  achieving 
model  following  between  the  system  and  the  reference  system  under  a fixed 
reference  control  uq.  The  extension  to  a reference  system  of  dimension 
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r^<p<n  will  be  considered  in  Section  5.3.  To  distinguish  between  re- 
sults of  Section  5.3  which  requires  the  definition  of  an  extended  output, 
we  give  the  following  definition. 

Definition  5 1 The  local  control  (5.3)  achieves  perfect  output  following 
if 

lim  e.  (t)  = lim  y^(t)  - y.  (t)  = 0 , i = l,  . . . \>  (5.16) 

t—oo  £— <d 

Recall  that  the  reference  interconnection  variables  y^,  i = l,...v  are 
governed  by  (5.2)  which  under  (5.5)  is  equivalent  to  (5.11)  where  Fi=Fn 
in  (5.12).  The  objective  now  is  to  investigate  the  existence  of  local 
control  (5.3)  such  that  perfect  output  following  results. 

5.2.1  Derivation  of  the  Local  Control  Law 
From  (5.6)  and  (5.11),  we  have 
v 

y = CAx  + Z CB.U.  + CEf  (5.17) 

i = 1 1 

y - DFo  W + DGu0  + DWf  (5.18) 

Subtract  (5.17)  from  (5.18) 


V 

e “ DF  w - CAX+DGu  - Z CB.u,  + (DW  - CE)f 
o o t = i 1 

(5.19) 

since  W = HE 

T 

T ~T  1 

and  H has  the  general  form  of  H=[C  H , then  W^=CE. 

Hence 

DW  - CE  = 0 

(5.20) 

Next  we  can 

write 

in 


W1 

A 

y 

i 

0 

w * 

W1 

w 

i 

0 

+ 

W1 

_! 

— 

— — 

T A - 

D y + S 


(5.21) 


Using  (5.21)  in  (5.19),  we  finally  get 

v 

e - DF  DTy  + DF§  - CAX  + DGu  - 2 CB,  u. 
o o o i i 

v 

- Fne  + (F11C-CA)x  + (CBuq-  2 CB.v^)  (5.22) 

If  the  imposed  control  law  (5.3)  is  substituted,  e becomes 

v v 

e - (F1L  - cBK)e +cBuo  - £ C\niuio  + (FllC’CA)x"  E CBiMiiXi 

. (5.23) 

where 


(5.24) 


Thus  from  (5.23),  we  see  perfect  output  following  by  control  (5.3)  requires 

(I)  For  k€  R113*1 , (F11-CBK)  be  stable. 

(II)  There  exists  i*l,...v  such  that 

v 

CBu  - E CB  tt  u = o (5.25) 

i*l 

(III)  There  exists  i*l,...v  such  that 

v 

(F..C-CA/X-  S CB  M xs  0 (5.26) 

ii  i-i  1 X1 

Remark  If  conditions  (II)  and  (III)  holds,  then 


♦ 
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e - (Fn  - CBK)e 

Thus  if  y(0)=y(0).  e(t)  3 0 vt.  Condition  (I)  is  required  if  initially 
y(0)  is  not  equal  to  $»(0). 

Theorem  5.1.  For  arbitrary  uq,  the  matrices  tt^,  i"l,...v  always  exists 
such  that 

v 

CBU°  = A CBiTTiUl°  (5 .25 ' ) 

Furthermore 

ni*  (CiBii)+(CiBii)+[l‘  (CiBii)+(CiBii)]Ni  (5.27) 

where  1L  is  a m.  xm.  arbitrary  matrix  and  X+  denotes  the  generalized  in- 
verse of  X [ 12] . 

Proof  of  Theorem  5.1  relies  on  following  Lemmas  on  generalized  inverse. 

Lenina  5.1  [12,  Theorem  5.19] 

If  W ■ NM  where  W,  N and  M are  respectively  mxn,  mxk  and  kxn 

matrices  of  rank  k,  then  the  solution  of  Wx“b,  x,b€Rn  which  minimizes 

T 

(a)  the  sura  of  squares  of  the  residual  r r where  r = b - Wx 

T + 

(b)  the  sum  of  squares  of  the  unknown  x x is  given  by  x=W  b where 

W+-MT(MMr)'1(NTN)'1NT  (5.28) 

Remark  Lemma  5.1  defines  W+  by  (5.28).  However,  we  note  r 20  if  and 
only  if  b€R(W).  in  general,  ri*0.  It  will  be  shown  that  conditions  for 
the  existence  of  freedom  component  in  local  control  ^ is  related  to  the 
class  of  W+  that  makes  r”0. 
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Lemma  5.2.  [12,  Theorem  5.20] 

The  generalized  inverse  W+  of  a mxn  matrix  has  the  following 

properties 


(i)  W+WW+  - W+ 


(ii) 


WWW  - w 


(iii)  WW+  and  W+W  are  symmetric  matrices. 

The  assumption  in  Lemma  5.1  that  W with  rank  k can  be  decomposed 
into  a producet  of  N and  M each  with  maximal  rank  is  assured  by  Lemma  5.3. 
Lemma  5.3  Any  mxn  matrix  W having  rank  equals  to  k can  be  factored  as 
W ■ NM  such  that  N^RmX^  and  m€r^xd.  Furthermore  N,  M have  maximal 
rank. 

Proof:  Since  w€Rmxn  has  rank  k,  then  there  exists  a kxk  submatrix  of 
W having  rank  equals  k.  Let  T^  and  Gaussian  matrices  [12]  which 

transforms  W into  W by 


TXWT2  - W - [W±  j]  , i,  j-1,2  (5.29) 

mm 

where  W^^R  is  nonsingular.  This  can  always  be  done.  Since  Tif  i-1,2 
are  non-singular,  rank  W * k.  Then  the  last  m-k  rows  of  W are  dependent. 

We  have 


W 


22 


- P W 


12 


(5.30) 


for  some  matrix  P.  Similarily,  the  last  n-k  columns  of  W are  linear 
combinations  of  the  first  k columns.  Hence  there  exists  a matrix  Q such 
that 


w. 


21 


Q 


(5.31) 


114 


From  (5.30)  - (5.31), 


P 


W21W11 


W11  ^12 


(5.32) 


giving  us 


W 


22 


PwnQ 


(5.33) 


(5.29)  - (5.33)  gives  three  different  factorization  of  w,  namely 


w - 

1*11  W12]  " 

*k 

“a 

p 

P 

ll^Ql-NM 


(5.34) 


where  N,  M each  have  rank  equal  to  k.  Using  (5.29),  W-T^1  W T2*  * 

(T^  N)(MT2^).  This  completes  the  proof. 

Using  Lemma  5.1  to  Lemma  5.3,  we  also  have 

Lemma  5.4.  Given  a mxn  matrix  W such  that  rank  W-k,  then  a generalized 
inverse  W+  always  exists. 

Proof  of  Theorem  5.1: 

Using  definition  of  C,  B.^  and  tt^  given  by  (5.27), 


£ CB.tt.u, 

i-i  1 1 10 


v 

£ 

i-1 


0 

Vii 

0 


{(CiBii)+<CiBii>  +[I  - <CiBii>XBii>lNi}uio 


v 

£ 

i-1 


CBi  uio  + 
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■ CBu  . 
o 

The  fact  (CjB^)*  exists  is  a consequence  of  Lemma  5.4.  Moreover,  from 
Lemma  5.2,  (C^)  (C^)*^^)  « (C^).  Hence  (5.27)  always  exists  and 
satisfies  (5.25). 

Theorem  5.2.  If  for  I v 


[ I - (CB^  (CBi)+]  (FnC  - CA)  - 0 
where  is  defined  by 


CVi 


(5.35) 


(5.36) 


then  Mil  exists  such  that 

v 

(F11C-CA)x-  Z CBiMiixi  (5.26') 

Furthermore 


Mii“  (CBi)+(FllC"CAVi  + tI‘  (CiBii)+(CiBii)lPi  (5*37) 

where  P^  is  a arbitrary  matrix. 

Proof:  (5.26')  may  be  rewritten  as 

v v 

£*11°  ‘ ^^i*!  " i^iCBi*11*i 

In  order  for  the  equation  to  hold  for  arbitrary  x^  we  must  require 
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(FnC  - CA)^  - CB1M11  (5.38) 

Using  (5.37)  in  (5.38)  and  applying  (5.35),  we  have 

v v 

2 CB1Milx1  • 2 (CBi){(CBi)+(F11C-CAyi+[l  - (CiBii)+(CiBli)]Pilx1 

v . 

" i2l(CBi)(CBi>  (FUC  * CAV^i 
v 

- 2 (F..C  - CAy.x. 
i»l 

- (FxlC-CA)x. 

Combining  Theorem  5.1  and  5.2,  we  now  state  the  main  result  of  Section  5.2. 
Theorem  5.3.  Assume  the  pair  (A,C)  is  not  completely  aggregable.  Consider 
the  LTI  system  (5.6)  expressed  in  its  GHR  (5.8)  and  the  reference  system 
(5.11).  Then  perfect  output  following  is  achieved  by  the  local  control 

ui  " "i  uio  + kie  +Miixi  ’ <5-39> 

if 

(i)  (F^,CB)  is  stabilizable 

(ii)  [I  - (CB1)(CBi)+]  (FX1C -CA)^1-0,  i-l,...v 

Proof:  In  order  to  achieve  perfect  output  following,  we  must  have 
(F^  - CBK)  be  stable  for  some  K and  tt^,  exists  ^i.  The  stability  of 
(F^  - CBK)  is  guaranteed  if  (F^,  CB)  is  stabilizable.  On  the  other  hand, 
the  existence  of  and  are  guaranteed  by  Theorems  5.1  and  5.2.  With 
and  chosen  according  to  Theorems  5.1  and  5.2,  (5.23)  reduces  to 

e - (Fu-CBK)e  (5.40) 


- - - 
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Hence  11m  e(t)"0  If  condition  (i)  holds.  This  completes  the  proof. 

t-HOB 

Using  the  expression  of  tt^  and  given  by  (5.27)  and  (5.37), 
we  note  the  local  control  (5.3)  is  equivalently  expressed  as 


(5.41) 


where 


uil  " (CiBii)+(CiBii)uio  +Ki®  + (CBi)+<Fnc  - CAViXi  (5.42) 
ui2  - [T  - (CiB1i)+(CiBii)]  (Ntuio+  P.xt).  (5.43) 


u^  is  used  to  achieve  complete  aggregability  and  perfect  output  following 

* 

while  u^  provides  freedom  in  control  synthesis  that  is  non-interactive 
with  u^. 

Corollary  5.3.1.  If  (A,C)  is  completely  aggregable,  then  perfect  output 
following  is  achieved  by  (5.3)  if  (F^,  CB)  is  stabilizable . 

The  proof  of  Corollary  5.3  follows  from  that  of  Theorem  5.3  if  we  note 
(A,C)  completely  aggregable  implies  (F^C-CA)s0. 

Remark . If  instead  of  assuming  that  e is  formed  by  the  coordinator  and 
the  component  K^e  in  u^  is  supplied  by  the  coordinator,  we  can  assume  e^ 
is  formed  locally  by  individual  subsystem.  Then  a decentralized  control 


(5.44) 


can  be  sought.  It  can  be  shown  that  with  tt^,  chosen  according  to 
Theorems  5.1  and  5.2. 

•Jq 

By  non-interactive,  we  mean  the  control  action  of  u^2  will  not  cancel  or 
affect  the  control  action  of  u^.  Thus  the  application  of  ui2  will  not 
destroy  aggregability  or  perfect  output  following  brought  about  by  u^. 
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r 


e “ (F11-CBK)e  (5.45) 

where  K €-V  ■ / K ■ block  diag  The  existence  of  a stabilizing 

gain  K is  studied  by  Davison  [52]  who  states  that  if  the  triple  {f^,  CB,l} 
has  no  unstable  fixed  modes,  then  a stabilizing  exists. 

5.2.2.  Properties  of  the  Local  Control  Law 

Theorem  5.3  and  (5.41)  indicates  that  u^  possess  a component  u^ 

ui2"[l“  (CiBii)+(CiBii)]  (Niuio  + Pixi)  ’ <5*46) 

which,  if  non-zero,  represents  the  freedom  available  in  shaping  the  dynamics 
of  the  residual  subsystem  beyond  achieving  of  aggregation  and  perfect  out- 
put following  by  u^.  It  is  important  to  examine  under  what  restriction 
on  the  system  structures  that  this  freedom  may  not  exist.  It  will  be 
shown  that  rank  of  the  matrix  product  CB  characterizes  the  available  freedom 
and  the  number  of  inputs  in  excess  the  number  of  outputs  is  crucial.  We 

mention  here  that  u. „ will  be  denoted  as  u.  in  Section  5.4  where  the  local 

lc 

control  u^  is  decomposed  into  u^a  for  controlling  the  aggregate,  u^  for 
achievement  of  aggregation  and  uic  for  controlling  the  aggregate. 

From  (5.46),  for  a given  pair  (B,C),  u^  2 0 for  arbitrary  matrices 
and  Pi  if  and  only  if  [I  - (CiBn)+(Ci3i{)}  *0*  T*iree  cases  occur: 

(a)  CB  has  maximal  rank  which  in  turn  may  be  subdivided  into  two  subclasses, 
namely  rank  CB*m<r  or  rank  CB*r<m;  (b)  CB  has  less  than  maximal  rank, 
i.e.  rank  CB<min  (r,m);  (c)  CB  = 0.  Each  class  will  now  be  studied 
separately. 
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Class  I rank  (CB)  * min(r,m) 

Class  I - a rank  (CB)  ■ m < r 

Since  CB  has  maximal  rank,  there  exists  (CB)+  such  that 

(CB)+  - [ <CB)T(CB)1 “1CCB>T  (5.47) 


and 


(CB)+(CB)-Im 


which  implies 


<C1B11)+(C1B11) 


I 

m. 

i 


Using  (5 .47)  - (5.49)  in  (5.46),  clearly 


(5.48) 


(5.49) 


ui2  s 0 (5.50) 

Hence  the  non-interactive  freedom  component  is  lost  in  the  sense  u^  " 0- 

Case  I - b rank  CB  * r < m 

Using  the  definition  of  B and  C in  (5.7), 

CB  * block  diag.  . . .C^B^l  (5.51) 

Thus  rank  C^B^  ■ r^<  m^.  Denote  dim  (C)  as  the  dimension  of  a subspace 
C,  then 

dim  **(^8^)  ■ r^,  dim  ker  (C^B  ^)  ■ m^  - r^.  (5.52) 


f 


m 


k 


I 
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In  addition,  *-s  a projection  matrix  [53]  into  range  space 

of  C^B^  and  [I  - (CjBj^)+(C^B^)]  is  a projection  matrix  from  a mi  dimen- 
sional space  into  a m^  - r^  dimensional  subspace.  Thus  [I  - (C^IJ^)  (C^B^)]?*  0 
in  general.  Hence  ui2  ^ ® *-n  general  and  there  ere  nu  - r^  degrees  of  freedom 
in  u^. 

We  can  summarize  the  results  for  Class  I as  follow: 

Theorem  5.4.  Assume  (A,C)  is  not  completely  aggregable  and  CB  has  maximal 
rank.  Then  there  exists  freedom  in  local  control  (5.3)  beyond  achieving 
complete  aggregability  and  output  following,  i.e.  u^  0 if  and  only  if 
rt<mi. 

Class  II  rank  CB*f<min  (r,m) 

ri  x nu 

(5.51)  implias  (C^B^^)  £ r , thus  either  rank  (ciBii)  “minOr^ra^) 

or  rank  (C^^)  * ^ < min  (r^m^).  Let  us  introduce  the  index  set 

'5j»{it,  t ■ 1,2, . . . s/ (C^  ^ ) has  maximal  rank} 

^2  *li..»  t ■ s+1, . . .k/(C.  B.  . )has  less  than  maximal  rank}. 

C Lt  t t 

c (5.53) 

Since  CB  has  less  than  maximal  rank,  there  is  at  least  one  index  belonging 

to«*0.  In  each  group,  (C^B^)  exists  by  Lenina  5.4.  In  particular,  for 

i£j^,  we  have  either 


('i'll'  Vii'-1.,  “"li'i 


(5.54) 


(5.55) 
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i 


j 


I 

I 

I 


In  view  (5.46),  * 0 if  i^  i^  and  or  ui2  i 0 if  16.^  and  r^nK. 

On  the  other  hand,  V i € <9^  , [l~  (CjB^^CjB^)]  This  Can 

be  argued  as  follow.  For  those  i € with  r^nu,  rank  C^B^  < min  (m^r  ) . 

Thus  rank  (ciBii)+(ciBii)  < mi  which  implies  (ciBii)+(CiBii)  has  less  than 

m.  nonzero  eigenvalues.  But  I has  m.  non-zero  eigenvalues.  Hence 
I m.  l 

4.  1 

[I  - (C.  B . . ) (C.B.  .)]  #0.  A similar  argument  holds  for  r . < m.  . 
i II  l 11  ii 

Theorem  5.5.  Assume  rank  CB=X<min  (r,m),  then 
ui9  *0  , iS^  and  m^r^ 

(5.56) 


ui2  + 0 , i € *9^  and  r^m^  or  ^ i € S . 


Class  III  CB  = 0 


Since  CB  = Gj=0,  then  from  the  GHR  structure,  it  is  clear  that 
independent  of  uq  or  u,  the  interconnection  in  G*®-  cannot  be 

compensated.  Hence,  any  compensation  in  order  to  achieve  aggregability 
must  be  carried  out  at  possibly  next  or  lower  layer  in  the  GHR  system 
matrix.  In  this  class,  neither  perfect  output  following  nor  freedom  in 
control  synthesis  exist. 

In  summary,  the  existence  of  a local  control  (5.3)  is  given  by 
Theorem  5.3.  In  general,  (5.3)  can  be  decomposed  into  ® u^a  +uic 

where  u^+u^^u^  and  uic”ui2’  Uil  an<*  Ui2  kein8  definad  in  Theorem 
5.3.  From  functional  point  of  view,  uia  allows  arbitrary  shaping  of  the 
aggregate  dynamics  if  (F^^,CB)  is  controllable,  achieves  complete 

aggregability  defined  by  (A,C)  by  decoupling  S*  from  S* . uic»  if  exists 
allows  the  shaping  of  the  residual  dynamics  by  both  local  state  feedback 
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and  changing  the  effective  feedforward  term  H^z^  * H^y  in  the  GHR.  More- 
over, uic  only  exists  if  r^  < nu  when  C^B^  has  maximal  rank  or  if  rank 
C^B^<min  (r^,m.).  The  details  are  given  by  Theorems  5.4  and  5.5. 

5.3.  Aggregability  and  Perfect  Extended  Output  Following  By  Local 
State  Feedback. 

The  result  of  Section  5.2  can  be  extended  to  include  the  more 
general  case  if  compensation  of  F^2^  in  ^HR  cannot  be  achieved  at 
the  first  layer  but  may  be  achieved  at  next  or  lower  layers.  Two  possi- 
bilities can  occur,  namely  the  reference  system  (5.2)  can  remain  at 
p*r^th  order  or  increases  to  higher  order  p,  p^<p<n.  The  need  to  in- 
crease the  order  of  the  reference  system  (5.2)  arises  when  the  system 
interconnection  variables  y.,,  i = l...v  are  best  modeled  by  high  order 
reference  system  or  the  GHR  structure  dictates  that  compensation  of  coupl- 
ing Hessenberg  blocks  must  be  carried  out  at  lower  layers  in  the  GHR, 
e.g.  when  G^  = 0 ^j<  i,  but  G^^O.  The  case  that  the  reference  system 
remains  at  r^th  order  may  be  reformulated  into  the  case  p>r^  by  making 
additional  assumption  on  the  range  space  of  and  G^  in  the  GHR.  However, 

we  will  not  treat  the  former  case  in  this  thesis.  To  simplify  the  forma- 

~ T -T  x 

tion  of  an  extented  error  e = [e  e ] which  contains  e,  we  assume 
i 

p*p.  * £ r,  in  (5.2).  Also  in  (5.2),  define  the  extended  reference 
1 1*1 

output  as  ye  =w' . Clearly  yg  contains  y,  i.e.  yg  * [y  y^j  . Assuming 

(5.5)  holds  for  the  triplet  (F^,  G' , Lr),  then  (5.6)  is  the  system  and 

(5.11)  is  the  equivalent  reference  model.  In  terms  of  the  GHR  structure, 

local  control  (5.3)  must  compensate  (cancel)  the  coupling  F.  . .-.z.  ,, 

1 , i+1  i+i 

i —i  i 

between  S and  S and  achieves  model  following  between  z and  w1  sub- 
sequently. In  the  remaining  sections,  a development  similar  to  Section 
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5.2  is  carried  out. 

5.3.1.  Derivation  of  the  Local  Control  Law 
Definition  5.2.  Since 


H x 
o 


HJ 

o 


(5.57) 


Then  y =C  x will  be  defined  as  the  extended  output  of  (5.6)  induced  by  y. 
J e e 

Let  the  reference  state  w of  (5.11)  be  partitioned  similar  to 
(5.57),  i.e. 


w = 


w ' 


w^ 


P4 

, w € R J 


Since  y and  y are  respectively  the  first  subvector  of  y and 
w',  then  lim  y (t)  = lim  y (t)  if  limy  (t)  = lim  w ' (t) . Similar  to  Section 

£— CD  t”*30  03 

5.2,  we  define 


ei  = yi  " yi  » 1 = .v 


e - ye  -w 


(5.58) 

(5.59) 


Again,  we  impose  the  local  feedback  control  structure 

u.  =tt.  u.  +K.e+M..x.,  i = l...v  (5.60) 

i 1 10  i ii  i 

Extended  output  following  is  defined  as  follows: 

Definition  5.3.  The  local  control  (5.60)  is  said  to  achieve  perfect 
extended  output  following  if 
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lim  e (t)  = lim  w^ (t) - y (t)  = 0 

£ — * CO  £ — *00  ® 


(5.61) 


Our  objective  now  is  to  obtain  conditions  for  the  existence  of  tt.  and  M,  . 

l ii 

A. 

and  to  examine  the  properties  of  the  local  control  (5.60)  so  that  e(t) 
approaches  zero  asymtotically . 

Equations  (5.6)  and  (5.55)  gives 
v 


y = C Ax  + Sc  B.u.  + C Ef 
e e . , e l i e 
i=l 

wj  = DjF  w + D-^Gu  + DjWf 


(5.62) 

(5.63) 


since  W = HE,  then  D^W=W^  = CgE.  Hence  with  u^  defined  by  (5.60),  it  can 
be  shown 


e = FJe  + (FJC  -C  A)x+C  Bu  - S C B.u. 

6 6 60  .^611 

i ~ ~ v i v 

= (FJ  - C BK)  e +C  Bu  - S C B.tt.u,  + (FJC  - C A)x  - S C B.M.,x. 

e e o e i i io  e e e i ii  1 


(5.64) 


where 


K = [K  0] 


(5.65) 


K is  a raxr  matrix.  Hence  perfect  extended  output  following  requires: 
(I)  There  exists  K € Rm x r such  that  (F^  -C  BK)  is  stable. 


(II)  There  exists  matrices  rr^,  i v such  that 


v 

C Bu  = S C B.u, 
e o ^ e i io 


(III)  There  exists  matrices  M^,  i = l,...v  such  that 


(5.66) 


• ' 


- *k i 
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V 

I CeBiMuxi 


(5.67) 


i*l 


If  tt^  and  Mii  indeed  exist  and  satisfy  requirements  (II)  and  (III),  then 


e “ (Fj  - CgBK)  e 


(5.68) 


which  implies  e 0 as  t-"®  if  requirement  (I)  also  holds.  Following 
essentially  the  development  of  Section  5.2  with  appropriate  modifications, 
the  following  theorems  are  stated  without  proofs. 

Theorem  5.6.  The  matrices  rr^,  i ■!,... v always  exist  such  that 


C Bu  » 2 c B.rr  u. 

e o . . e i i io 
ial 


for  any  uq.  Furthermore, 


"i-<c.*i>+<W  + [Im.  - <W+<CeBl>lNi 


(5.69) 


where  is  any  m.  xm.  arbitrary  matrix. 

Theorem  5.7.  If  for  i ■ 1, — v , J defined  in  (5.36), 


[I  - (CeB.)(CeB.)+]  (FJCe-CeAyi  = 0 


(5.70) 


then  Mii  exists  such  that 


V 

(FjC  -C  A)  x = S CBM  x, 
e e e l ii  I 


Furthermore , 


^i’  (CeBi)+(fJce  "CeA>^i+[1'  (CeBi)+(CeBi)]  Pi  (5,?1) 


where  v,  is  a m.  xn.  arbitrary  matrix. 

Theorem  5.8.  Assume  (A,C)  is  non-aggregable . Consider  the  system  (5.6) 
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and  the  reference  model  (5.11).  Then  perfect  extended  output  following 
is  achieved  by  the  local  control 


■TT1uio+K1e  +Miixi,  i = l,...v 


(5.72) 


if 


(i)  a(Fj/V1)flc(Fj/V2)  are  stable  where  is  the  smalles  - 
invariant  subspace  containing  ker(D^}  and  V ,,  is  the  smallest 
(F^  )T-invariant  subspace  containing  ker{  (C^B)3'} . ct(fVv^)  ,i*l,2 
represents  eigenvalues  of  F^  restricted  to  V^. 

(ii)  [I  - (CeB.)(CeBi)+]  (FjCg  - CeA)^  - 0 , 1-1...V 


Furthermore, 


ni  " (ceBi)+(ceBi)  + H - <CeBi)+(CeBi)]Ni  (5*73) 

Mu=  (CeBi)+(Fjce  -ceA)*'i  + [l  ' (CeB.)  + (C^)]  P.  (5,74) 
where  and  P are  arbitrary  matrices.  And  u^  may  be  decomposed  into 


ui  " uil  + Ui2 


(5.75) 


with 


uil  ■ (CA>T<W'io+V  + <CeBi>+<fJCe  - c 4)->i  (5.76) 


uu  - ( ! - (Ce»1)+(CeB1)]  O^I./  + PjXj) 

Proof:  With  and  chosen  according  to  (5.73)  - (5.74),  and  if 
condition  (ii)  holds,  then 


(5.77) 
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e - (FJ  - C B K)  e 
e 


(5.78) 


Since  K ■ [K  0],  K€Rm'"r.  Define  D^*[l^  0]  as  an  output  matrix.  Then 

the  triple  (F^ , (C^B),  D^ ) of  (5.78)  defines  an  output  feedback  stabiliz- 
ability  problem.  The  existence  of  K is  guaranteed  by  [54]  which  is  in- 
terpreted by  condition  (i).  The  rest  follows. 

Theorem  5.8  again  indicates  a decomposition  of  u^  into  two 

functional  components.  The  role  u^  plays  in  arriving  at  (5.78)  indicates 

that  it  is  used  to  achieve  aggregability  by  compensating  the  interconnection 

1 

Fj  Zj+1  between  S and  S . In  addition,  it  also  shapes  the  dynamics  of 
the  decoupled  aggregate.  On  the  other  hand,  u^  represents  the  freedom 
component  in  synthesizing  the  local  control  u^.  From  (5.77),  we  note  u^ 
has  two  components.  The  first  component  [ I - (C  B£)+(CeB^)]NjLj»^  represents 
the  shaping  of  effective  feedforward  term  H^z ^ in  the  residual  from  the 
aggregate.  This  is  so  because  the  aggregate  state  w^  is  utilized.  The 
second  component  in  u^  > namely  [I  - (CgB^)+(  C^B^]  P.x^  represents  the  shaping 
of  the  residual  dynamics  through  local  feedback.  Even  though  the  feedback 
is  introduced  through  x^^  instead  ofw^,  we  note  w ^ and  compliment  each 
other  in  the  state  space.  Since  the  aggregate  is  decoupled  from  the  residual, 
any  state  feedback  that  does  not  affect  the  dynamics  of  the  aggregate  must 
not  involve  the  aggregated  state  w ^ . 

5.3.2.  Properties  of  the  Local  Control  Law 

From  (5.77),  we  observe  u - uic  ’ 0 lf  and  only  if 


[I  - (CgBi)  (CeB.)]  - 0 . 


(5.79) 


Similar  to  the  previous  section,  we  classify  CeB  according  to  (a)  CeB  has 
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maximal  rank;  (b)  C B has  less  than  maximal  rank  but  nonzero  and  (c)  c Ba0. 

e e 

i 1 

Class  I rank  (CgB)  » min  (p,m),  p ■ ri  ■ dimw. 

Class  I-a  rank  (CeB)  ■ m < p 
Since 


C B - [C  B.  ...  C B ] 

e ei  e v 


ml 


columns 


% 


columns 


(5.80) 


then 


rank  C^  - m^.  < p (5.81) 

(5.81)  implies  V i,  there  exists  (C^^)*  such  that 

(CeB1)+(CeBi)  - 1^  (5.82) 

Thus  [I  - (CeBi)+(CeB1)]  5 0 which  implies  ui2  - 0 V i. 

Class  I-b  rank  C B » p < m 
e 

Several  possibilities  can  occur  in  this  class,  namely,  rank  C Bj-m^sp, 
rank  C Bt"p<mt  or  rank  C^Cmin  (p,mt).  Define  the  index  sets 

£j*Ci/rank  CeBi*p<mi  or  rank  CeBi  < min  (p,mi)} 

■{  i/rank  C^^n^p! 

The  assumption  that  rank  CeBMp<m  implies  cannot  be  exhaustive,  i.e. 
not  all  indices  belong  to  f2.  Due  to  (5.82),  it  is  easy  to  see 


T— 
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Consequently 


u-  (CeBi)+(CeB1)] 


( non-zero 


v 


0 


, if 

, if  i€f2 


u 


i2 


(non-zero 
0 


if  i€lj 
if  i<=*2 


Class  II  rank  CeB  < min  (p,m) 

Px®1 

From  (5.80),  CgB^  € R . Clearly  rank  C^.^  = p is  impossible. 
On  the  other  hand,  we  may  group  C^  into  two  different  index  sets 


^“{i/rank  (CeBi)<min  (nr.p)] 
j?2  -(i/rank  (C^)  » m.  < p} 

Again  we  note  cannot  be  exhausive.  Hence  Since 


Then 


. non-zero 

tl-(CB)  <CB)]- 

0 


1£  i(h 

u 


non-zero  , if  i € ^ 

ui2  * 

0 , if  i€^2 

Theorem  5.9.  Assume  (A,C)  is  non-aggregable . Then  there  exists  freedom  in 
control  synthesis  in  the  sense  u12  + 0 if  and  only  if  rank  C Bt < min^.p) 
or  when  the  number  of  extended  output  is  less  than  number  of  local  controls, 
i.e. 


u 


12 


( non- zero 


V 


if  i € or  i € ^ 
if  i€f2  or  i€£ 
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Class  III  C B = 0 
e 

Independent  of  u or  uq,  the  interconnection  between  and  , 
cannot  be  compensated,  because  the  control  coefficient  matrix 
for  the  aggregate  subsystem  is  zero.  Thus  aggregability  cannot  be 
achieved . 

Conclusions  similar  to  those  at  the  end  of  Section  5.2.2  can  be 

summarized.  The  important  point  to  be  emphasized  is  that  u^  again  possess 

three  basic  components,  i.e.  u.*u.  + u.,  +u.  , u.  +u.,  ■ u. , and  u.  ■u.,,. 

i ia  ib  ic  ia  ib  il  ic  i2 

Uia’  Uib  an<*  Uic  are  usec*  t0  contr°l  the  aggregate,  to  achieve  aggregation 
and  to  control  the  residual  respectively. 

5.4.  A Decomposition  in  Optimization  and  Control  Synthesis 

Consider  again  the  interconnected  system  (5.1).  Suppose  that 

associated  with  each  subsystem,  a quadratic  cost 

00 

Jt  ■ ^fQ  + utRiuidt  , i"l...v  (5.83) 

is  to  be  minimized.  This  section  investigates  the  possibility  of  de- 
composing ^ into  a system  level  cost  to  be  associated  with  the  coordinator 
proposed  in  the  beginning  of  Chapter  5 and  a subsystem  level  cost  to  be 
associated  with  each  individual  subsystem  in  (5.1). 

From  previous  sections,  we  notice  u^  may  be  decomposed  into  three 

components 


ia 


+ uib  + u 


ic 


(5.84) 


where  the  role  of  u^a  is  to  control  the  aggregate;  the  role  of  uib  is  to 
achieve  aggregation  and  the  role  of  u^c  is  to  provide  some  freedom,  if 
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exists,  to  control  the  residual.  It  will  be  shown  that  a suboptimal 

solution  to  optimizing  (5.83)  with  respect  to  (5.1)  may  be  obtained  by 

first  solving  a coordinator  problem,  thus  defining  the  component  u,  ; 

la 

next  specify  the  resulting  optimal  dynamic  behavior  of  the  system  inter- 
connection variable  y^,  i = l...v  under  uia  to  each  local  subsystem  (5.1); 
finally  with  each  local  subsystem  having  complete  knowledge  of  this  desired 
interconnection  behavior,  the  remaining  component  u^b  and  u^c  are  obtained 
at  subsystem  level  simultaneously,  thus  achieving  parallel  computations. 

We  assume  here  that  a first  layer  aggregate  in  the  GHR  will  be 
used  to  govern  the  dynamic  behavior  of  the  system  interaction  variables 
y^,  i*l  ...  v.  Given  the  GHR  (5.8),  if  higher  order  aggregate  is  selected, 
the  procedure  described  below  can  be  modified  accordingly  and  thus  will  not 
be  considered  in  this  thesis.  The  aggregate  in  GHR  corresponding  to  the 
r^th  order  reference  system  is  then 

v 

y • Fuy  + F12z2  + £ CB^  (5.85) 

and  the  component  u^b  is  used  to  compensate  the  coupling  term  ' 

Let  2^  denote  the  state  space  corresponding  to  subsystem  state 
x^.  Since  y^-C^x^,  the  subsystem  state  space  can  be  decomposed  into 
the  range  space  of  and  null  space  of  C^,  i.e.  ^ . Thus 


ia 


+ x 


ib 


(5.86) 


where 


*U  ■ Ct+yi  ' ClVl6ZU 

*ib  " ’ I1"0!  cl,:<ieZlb 


(5.87a) 

(5.88) 


l 


— T— 


1 
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Clearly  being  the  range  space  of  corresponds  to  the  aggregate 

variable  y^,  thus  we  associate  the  component  with  2^.  On  the  other 

hand,  the  complement  of%^a  *s  the  residual  represented  byX^>  since 

u,.  and  u.  affects  the  residual  ( through  effective  feedforward  from 
lb  lc 

i — l 

S into  S and  feedback  of  residual  states),  we  shall  associate  u^  and 
uic  with  2^*  Also,  in  order  to  make  u^c  non-interactive,  it  is  necessary 
to  restrict  u^c  to  lie  in  the  null  space  of  CB.,  . Thus  u4/,  has  the  general 


ic 


form 


ulc  - [ 1 - (CBi)  (CB^)  (Nty  + P^) 


(5.89) 


where  N^,  P^,  i v are  arbitrary  matrices.  Denote  uifa  as 


Uib  " MiiXi  1 * 1» 1 ' *V 


(5.90) 


where  is  some  fixed  gain  for  the  purpose  of  achieving  compensatory 
action.  Since  uia  will  be  designed  as  a feedback  of  the  aggregate,  let 


“l.  ■ V 


(5.91) 


Then  using  (5.84),  (5.86),  (5.90)  - (5.91)  in  (5.83),  it  can  be  shown 
00 

Ji  " *fo(xia  +xib)Tqi(xia  +Xib)  + (uia  +uib  +uic)TRi(uia  +Uib  +uic)dt 


Jia+Jib 


(5.92) 


where 


Jia“^o  + UL  RiUiadt 


(5.93) 


1 


0 


I „ 


• .. 


A 
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j. . - jq- 

ib  ' o i ic  xio 


ic 


dt 


— — 

- 

y 

Qio- 

Qi  R4 

Qi  = 

0 12 

~T 

~ T n 

xi 

Ri  Ri 

Qil2  Qi22 

(5.94) 


(5.95) 


«il2  " Wii 


Qi22  " [ 1 - ci+cil Qi[  1 - ci+cil  +C.+CiQ1[l  -C^C.] 


+|i-ci+ciIVi+ci+MiiVii 


SJ  * Rtt  L.  Mil] 


(5.96) 


(5.97) 

(5.98) 


Next  we  realize  the  application  of  u^  causes  (5.85)  to  become 

v 

y - Fny  + 2 CBt  (uia +u.c)  . 
i=l 

Since  u.  is  to  be  non-interactive  in  the  sense  u.  lies  in  the  ker  CB. , 
1r%  ic  ’’ 


vic 

then  2 CB.u.  =0  which  yields 
i-1  1 lc 


* " Flly  + 1^C,i“u 


(5.99) 


(5.93)  and  (5.99)  forms  the  aggregate  optimization  problem  which  we  define 
as  the  coordinator  problem. 

Coordinator  Level  Problem 


min  J - 2 or  j (u  ) 
a iml  i la  ia 

ia 


(5.100a) 


subject  to 
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v 

y - Fuy  + s cVia  (s.ioob) 

QO 

Jia  ■ ifatViX  + "JRi  “ladt  <5-l00c> 

V 

where  2 a - 1. 
i-1  1 

In  defining  the  coordinator  problem,  co-operation  between  u^,  i"l...v 
is  assumed.  Thus  it  can  be  solved  as  a Pareto-optimal  differential  game 
problem  [55] . 

Let  the  solution  to  the  coordinator  problem  be  written  as  in 
(5.91).  The  closed-loop  aggregate  of  (5.99)  after  implementing  the  solu- 
tion (5.91)  may  be  expressed  as 


y “ (Fn  + CBL)y  (5.101) 

j T T 

where  L = [L^  ...  1^]  . On  the  other  hand,  with  the  application  of  and 
u^>  the  subsystem  equation  (5.89)  may  be  written  as 

v 


x 


i 


AiiXi  + ^ Aijyj  + Bii(Liy+MiiXi  + Uic) 

J* 

(Aii  +BiiMii)xi  + (Aii  +BiiLi)y  +Biiuic>  1-1 » 


.V 

(5.102) 


where  2 A.  .y.^A.  .y.  Assume  the  closed-loop  aggregate  dynamic  (5.101)  is 
j-1  J J 

5+1 


known  to  each  subsystem  (5.102)  as  a reference  dynamic  for  the  system 
interconnection  variable  y^,  i"l,...v,  then  augmenting  (5.101)  and  (5.102), 


we  get 
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y 

Fu  +CBL 

0 

y 

0 

*i 

V+BiiLi 

Aii+BiiMii 

xi 

+ 

Bii 





_ 





i=l, . . .v 

(5.103) 


It  is  interesting  to  note  (5.94)  and  (5.103)  may  be  solved  as  a separate 
optimization  problem  at  the  subsystem  level  without  additional  information 
from  other  subsystems.  However,  this  subsystem  level  problem  is  not  totally 
unconstrained,  since  according  to  (5.84),  u^c  must  lie  in  the  ker  CB^  for 
each  index  i in  order  to  be  non-interactive.  This  constraint  can  be  taken 
into  account  by  modifying  the  control  coefficient  matrix  . This  can  be 
seen  if  we  define 

VI 


ic 


'"i  "ii1 


then 


Vic 


BtI I - (CB.)+(CB.)]uic' 


a.  u.  1 

i ic 


(5.104) 


We  note  here  that  there  is  an  implied  mutual  agreement  between  the  sub- 
system controller  in  choosing  u^  and  the  general  form  of  u.^.  Although 
u^c  must  lie  in  ker  CB^,  it  is  arbitrary  in  the  sense  uic'  is  arbitrary 
as  seen  in  (5.104).  The  subsystem  level  optimization  problem  can  then 
be  defined  as: 

Subsystem  Level  Problem 


min 


ib 


dt 


(5.105a) 


subject  to 


136 


\ ' «i\  + 0i"L 


v ■ ^ H 1*1  v 


where  T|^  and  Qio  are  defined  in  (5.95)  - (5.98)  and 


(5.105b) 

(5.105c) 


Fn+CBL  0 

8.  = 

0 

Aii  + BiiLi  Aii  + BiiMii 

Mi 

B..[I  - (CBi)+(CBi)] 

> -[0  — 0 I 0...0] 

' i 


(5.106) 


Thus  by  modifying  the  control  coefficient  matrix,  the  subsystem  level  problem 

is  again  an  unconstrained  optimal  regulator  problem.  Extensive  results  can 

be  found  in  [56],  One  must  emphasize  that  the  subsystem  level  problem  (5.105) 

may  be  solved  independent  of  other  subsystem's  optimization.  The  only 

requirement  is  each  subsystem  must  know  the  closed-loop  dynamics  of  the 

aggregate  under  the  influence  of  u.  . For  a truly  large  scale  system  of 

Id 

high  dimensionality,  the  order  of  the  aggregate  (the  reduced  order  model  of 
the  system)  can  be  small.  Hence  even  coupled  with  each  subsystem  dynamic, 
the  dimension  of  T|^,  i*l,...v  is  still  considerably  smaller  than  the  order 
of  the  composite  system.  In  addition,  with  the  decomposition  suggested, 
the  original  problem  (5.88)  - (5.89)  may  be  solved  by  a sequential-then-parallel 
computations.  The  steps  are  summarized  as  follow: 

Step  I Obain  GHR  system  representation  of  the  composite. 

Step  II  Base  on  system  structural  considerations,  decide  the  order  of 


aggregate  subsystem  desired.  Eigen-analysis  , GQL  algorithm 
application,  capability  of  compensatory  control  to  achieve 
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aggregation  if  initially  not  aggregable  may  be  carried  out  at 
this  step. 

Step  III  Choose  and  apply  compensatory  control  for  each  subsystem  to 
achieve  aggregation  and  decoupling. 

Step  IV  Solve  the  coordinator  level  problem  (5.100)  for  u._. 

la 

Step  V Apply  u_.  and  obtain  closed-loop  aggregated  system  (5.101)  and 

la 

specify  closed-loop  dynamic  (5.101)  to  each  individual  subsystem. 

Step  VI  Solve  subsystem  level  optimal  control  problem  for  u^c  and  apply 

u,  • 
ic 

Thus  at  Step  VI,  we  see  parallel  computations  to  be  carried  out 
locally  at  each  subsystem.  Such  computation  savings  can  be  used  to  increase 
efficiency  in  solving  large  scale  system  problem  and  thus  represent  a dis- 
tinct advantage  over  existing  methodologies.  The  implementation  configuration 
of  the  local  u^  is  given  in  Figure  5.2. 

We  conclude  this  section  by  remarking  that  the  subsystem  level 
problem  (5.105)  is  posed  as  a full  state  feedback  optimization  problem. 

If  u is  restricted  to  feedback  only  locally  available  informations,  e.g. 
x^  or  x.  plus  those  components  of  y locally  measurable  at  each  subsystem, 
then  the  problem  becomes  a constrained  output  regulator  problem  [43,57  -58] . 
In  Chapter  6,  the  results  of  this  Chapter  will  be  applied  to  study  two 
power  system  examples. 


FP-6108 


Figure  5.2.  Implementation  structure  of  proposed  hierarchical 
control. 
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CHAPTER  6 


APPLICATIONS 


Four  examples  are  given  in  this  chapter.  Examples  6.1  and  6.2 
illustrate  the  usefulness  of  GHR  and  the  GQL  algorithm  in  obtaining 
suitable  reduced  order  models.  Examples  6.3  and  6.4  illustrate  the  role 
of  the  GHR  in  solving  the  synthesis  problem  considered  in  Chapter  5.  The 
existence  of  local  feedback  and  decomposition  of  local  control  to  achieve 
aggregation  are  shewn.  The  sensitivity  of  output  trajectories  with  res- 
pect to  u^  is  also  studied.  To  assess  the  performance  of  reduced  order 
models,  both  open-loop  and  closed-loop  trajectories  are  simulated.  For 
closed  loop  analysis,  we  distinguish  three  different  regulator  designs: 
Optimal  Regulator: 

Given  a LTI  system 


x = Ax  + Bu  , x € Rn  , u?Rm 


(6.1a) 


y ■ Cx 


, y€R 


(6.1b) 


The  optimal  control  u “Lx  that  minimizes  the  cost 

o o 


J a 1 ^ yT  Q y + uT  r u dt 

L v O 


(6.2) 


is  obtained.  Here  Q and  R satisfy  the  usual  assumptions  of  positive  semi 
and  positive  definiteness.  The  optimal  closed  loop  system  is  then 


x = (A  + BLq)x 


y = Cx 
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Reduced  Regulator 


Consider  the  GHR  of  (6.1) 


FEz  G 

r r r 


+ u = Fz  + Gu 


H F z G 

r r r 


y =*  [D  0]  z _ 

r = Dz 


(6.3a) 


(6.3b) 


and  its  approximate  aggregated  model  (reduced  order  model  of  (6.1)). 


z * F z +Gu  , z € R* 
r r r r r 


y = D z 
3 r r 


(6.4a) 


(6.4b) 


Let  the  control  u * L z be  the  control  that  minimizes  the  cost 
o or 


« 1 »T  * T 

J ^ 2 Jo  y Qy  + U Rudt 


(6.5) 


with  respect  to  (6.4).  Again  Q and  R satisfy  the  usual  assumption  and 
take  on  same  values  as  in  (6.2).  The  optimal  reduced  order  closed  loop 
system  is 


z - (F  + G L)  z 
r r r r 


y ■ D z 
1 r r 


Suboptima 1 Regulator 


Define  the  control 


r 
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"sub  ■ t1  01 


-i 

z 


V 


(6.6) 


as  the  suboptimal  control,  the  application  of  (6.6)  is  assumed  to  give 
suboptimal  behavior  to  the  optimal  regulator  (6.1)  - (6.2).  The  resulting 
controller  is  termed  the  suboptimal  regulator.  The  suboptimal  closed-loop 
system  is 


z = (F+GLg)z 


y * Dz 


or  equivalently 


x = (A  + BLgH)x 


y = Cx 


where  H is  the  GHR  transformation  matrix. 

In  all  output  trajectory  simulation,  0,  R,  S denote  the  optimal, 
reduced  and  suboptimal  regulators  respectively. 

6.1  Model  Reduction  of  a Single  Area  Power  System 

Consider  a single  area  power  system  consists  of  two  interconnected 

thermal  plants  [591  : 


x ■ Ax  + Bu  + Eui 


Cx 


(6.7a) 


(6.7b) 


where  xgR9,  ufR2,  y€R3,  andu>€R.  The  state,  control,  disturbance  and 
output  variables  have  the  following  meanings: 
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Aa^  - valve  position  displacement  in  first  unit 

AP  - power  output  displacement  of  HP  turbine  in  first  unit 

AP  - power  output  displacement  of  IP  turbine  in  first  unit 

C2 

AP  - power  output  displacement  ©f  LP  turbine  in  first  unit 
t3 

“ valve  position  displacement  in  second  unit 

AP  - power  output  displacement  of  HP  turbine  in  second  unit 

AP  - power  output  displacement  of  IP  turbine  in  second  unit 

C2 

AP  - power  output  displacement  of  LP  turbine  in  second  unit 
t3 

Af  - frequency  deviation  in  the  system 

Af  - set  point  adjustment  in  first  unit 
ml 

Af  - set  point  adjustment  in  second  unit 
m2 

AP.  * load  disturbance 

L 

AP,  - total  power  output  of  first  unit 
AP2  " total  power  output  of  second  unit 
Af  - frequency  deviation  in  the  system. 


And  the  system  matrices  have  the  structure: 


ail  ° 


a21  a22 


0 a32  a33 


0 0 a 
0 0 
0 0 i 

0 0 i 

0 0 


43  a44 


0 a 

0 a 


92  93  94 


0 

0 

0 

0 

ai9 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

a55 

0 

0 

0 

a59 

a65 

a66 

0 

0 

0 

0 

a76 

a77 

0 

0 

0 

0 

®87 

a88 

0 

0 

a96 

a97 

a98 

a99 

0 C 

0 C 

0 bc 
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C 


0 c12  C13  C14 

0 0 0 0 

0 0 0 0 


0 

0 

0 


0 


0 0 


C26  C27  c28  C29 
0 0 0 1 


(6.8) 


The  entries  of  (A,B,E,C)  in  terms  of  physical  parameters  and  their  values 
are  given  in  Appendix  E. 

Let  us  initially  carry  out  the  chained  aggregation  procedure 

3 

described  in  Chapter  2 in  order  to  obtain  the  GHR.  Note  ygR  , and 
C ■ [C^  cn^  * ^rom  (6-8),  is  singular.  A initial  state  permutation 

is  necessary.  From  C,  we  pick  columns  four,  eight  and  nine  as  the  first 
three  columns  of  the  permuted  C.  In  doing  so,  we  have  placed  the  outputs 
of  the  last  stage  of  turbine  in  each  plant  and  the  system  frequency  as  the 
leading  state  components.  Formally  this  is  achieved  by  using  the  permuta- 
tion matrix  of  the  chained  aggregation  transformation.  Then  the  per- 
muted system  matrices  are: 


5 


to  the  system  (6.9)  which  results  in  the  representation 


while  the  output  equation  becomes 
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100000000 

010000000 

001000000 


Note  that  in  (6.10)  the  submatrix  F^i 


F ' 
e 12 


P14  P15  P16 


0 

0 


0 

0 


0 

0 


P27  P28  P29 


(6.11) 


is  not  a zero  matrix,  so  a complete  aggregation  with  respect  to  C is  not 
possible.  We  proceed  to  the  next  step  in  the  chained  aggregation  proce- 
dure. Note  that  rank  Fj^  “ 2 and  the  interaction  term  entering  the  first 
aggregate  has  two  independent  components.  These  become  the  outputs  from 
the  residue  and  are  denoted  as  y^  and  y^: 

P14  P15 
0 0 


P16 
0 p 


27  P28  p29 


(6.12) 


The  residual  system  becomes 
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0 
0 

*33 
0 a 

0 

0 


0 

0 

0 

55 

l65 

0 


o o a ~ 

- - 

b, , 0 

19 

11 

0 0 0 

yl 

0 0 

0 0 0 

0 0 

y2 

+ 

0 0 a_  „ 

0 b. , 

59 

51 

0 0 0 

y3 

0 0 

0 0 0 

0 0 

— — 

— - 



(6.13) 


Observe  that  (6.13)  represents  two  completely  uncoupled  third  order  systems. 
Moreover,  (6.12)  shows  that  each  of  the  two  outputs  comes  from  a separate 
subsystem.  Such  uncoupling  is  consistent  with  the  fact  the  physical  system 
is  an  interconnection  of  two  identical  thermal  plants.  It  is  these  system 
structural  features  that  are  retained  and  exhibited  by  the  GHR.  The  use 
of  given  output  information  structure  to  induce  reduced  order  modeling  is 
thus  appealing.  Because  of  this  total  decoupling  in  the  residual, it  is 
possible  to  proceed  in  either  of  two  possible  directions.  The  first  is  to 
introduce  the  second  permutation  on  (6.13)  which  will  arrange  the  components 
in  the  measurement  matrix  (6.12)  so  that  C^2  is  nonsingular.  The  procedure 
is  then  repeated  as  described  above  by  defining  the  new  transformation 
matrix  forming  the  transformed  state  equations  of  this  residual  and 
proceeding  further  as  described.  The  other  possibility  is  to  consider 
separately  the  two  decoupled  systems  and  obtain  their  GHR  with  respect  to 
their  measurement  vectors,  and  then  compose  these  into  the  GHR  of  the  coupled 
system  by  permuting  the  order  of  the  state  variables.  In  both  cases,  (6.7)  is 


r 
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brought  into  the  following  GHR : 


*1 

- 

fli 

f12 

f13' 

1 

0 

0 

0 

0 

^2 

f21 

f22 

f23 1 

0 

1 

0 

0 

0 

*3 

f31 

f32 

f33i 

0 

0 

0 o 

0 

’*4 

°" 

“o 

f43 : 

f44 

“0“ 

1 

0 

~ o' 

jj. 

m 

0 

_ 

0 

.*»! 

0 

bi 

0 

1 

0 

*6 

0 

0 

0 

1 

f64 

0 

f66 

0 

' f68 

h 

0 

0 

0 

0 

.£z? 

0 

j_77_ 

1 o 

*8 

0 

0 

0 ' 

1 

0 

0 

f 86 

0 

\ f88 

*9 

0 

0 

o ! 

0 

0 

0 

f97 

1 0 
| 

L J 

— 

1 

1 

! h 

11 

0 

0 

0 

T 

0 


;79 

0 


f 99 


‘21 

*31 

'0'' 


.9. 

0 

.9. 

o 

o 


(6.14) 


The  block  structure  induced  by  the  chained  aggregation  with  respect  to 
the  available  measurements  is  shown  by  the  dashed  lines.  The  output 
equation  associated  with  (6.14)  is  given  by  (6.11). 

Having  obtained  the  GHR  we  now  exploit  its  structural  properties 
to  select  a reduced  order  model.  It  is  Immediately  seen  that  aggregation 
to  a third  order  model  is  unsatisfactory.  The  result  would  be  a system 
unaffected  by  the  control,  and  acted  upon  by  the  external  disturbance. 
Clearly  the  interconnection  into  the  third  order  aggregate  from  the 
residual  is  significant.  On  the  other  hand,  a fifth  order  reduced  order 
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model  is  justifiable.  Separating  the  composite  system  into  the  aggregate 
subsystem  and  the  residual  subsystem,  and  denoting  the  states  of  the 
aggregate  model  by  z,  we  have 


*1 

fll 

f 12 

f13 

1 

0 

Z1 

0 

0 

0 

0 

hll 

*2 

a 

f21 

f22 

f33 

0 

1 

Z2 

0 

0 

y6 

0 

0 

ul 

h21 

*3 

f 31 

f 32 

E33 

0 

0 

Z3 

0 

0 

\r 

+ 

0 

0 

11 

+ 

h31  1 

*4 

0 

0 

f43 

f44 

0 

Z4 

1 

0 

y7 

841 

0 

U2 

0 ! 

*5 

0 

0 

f53 

0 

f55 

z 

Z5 

0 

1 

0 

S52 

o ; 

J 

— 

— 

— 



— — i 

and  for  the  residual  system 


y6 

f66  0 f68  ° 

y6 

f64  0 

y7 

a 

0 f77  ° f79 

y7 

+ 

0 f75 

y4 

y8 

f86  ° f88  0 

y8 

0 0 

y5 

y9 

0 f97  0 f99 

y9 

0 0 

L J 

— — 

Note  first  that  all  controls  and  external  disturbances  enter  only  into 
the  aggregate  model  and  not  into  the  residual  directly.  Although  the 
indirect  effect  of  the  disturbance  (through  feedforward  from  the 
aggregate  and  then  as  feedback  from  the  residual  to  the  aggregate)  from 
the  residual  is  coupled  back  to  the  aggregate  by  the  Hessenberg  block,  such 
effect  is  secondary  and  if  the  coupling  between  the  aggregate  and  the 
residual  is  weak,  we  may  assume  most  effects  of  external  disturbance 
inputs  is  accounted  for  in  the  aggregate  model.  Second,  the  aggregate 
model  is  completely  controllable  and,  third,  the  interconnection  variables 
which  come  from  the  residual  may  be  cancelled  by  residual  state  feedback 
because  RCF^^)  c R (£2)-  Thus  it  is  conjectured  based  on  structural 
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r 


1 


considerations  that  the  reduced  order  model 


will  produce  the  basic  features  of  the  higher  order  model  (6.7).  Using 

the  parameter  values  given  in  Appendix  E,  the  GHR  system  matrices  (F  G,W,D) 

2 2 2 2 

are  given  in  Table  6.1a  and  the  reduced  order  model  matrices  (F  ,G  ,W  ,D  ) 
are  given  in  Table  6.1b. 

With  the  assumption  of  a fifth  order  reduced  order  model,  the 
Hessenberg  block  F23  is  initially  neglected  to  obtain  an  approximate  GHR 
without  compensation  or  parameter  adjustment.  The  open-loop  eigenvalues 
are  compared  in  Table  6.2.  The  lack  of  resemblance  in  open- loop  eigen- 
values can  be  attributed  to  the  fact  that  we  are  asking  five  modes  to 
model  the  input-output  behavior  of  a 9th  order  system.  Thus  an  algebraic 
combination  of  the  original  system  modes  results  in  general.  To  assess 
the  closed  loop  behavior,  the  three  regulator  designs  given  at  the 
beginning  of  Chapter  6 are  implemented.  Two  cases  are  considered.  Case 
A assumes  Q “ I,  R * I in  (6.2)  and  (6.5)  while  case  B assumes  Q * 10  I,  R “ I 
for  the  costs.  The  corresponding  closed  loop  eigenvalue  for  the  optimal 
and  suboptimal  regulators  are  presented  in  Table  6.3  and  6.4  respectively. 
In  case  A,  it  is  seen  that  both  the  optimal  and  the  suboptimal  design 
show  the  same  general  pattern  of  pole  locations,  exhibiting  a cluster  of 
five  dominant  modes  and  four  faster  modes  clustered  in  two  pairs.  We 
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Table 


2 2 2 2 

.lb.  System  matrices  (F  ,G  ,W  ,D  ) of  the  aggregated 
model 


.99375 

0.00625 

0.28125 

1.0000 

0.0000 

.00625 

-1.99375 

0.28125 

0.0000 

1.0000 

.04167 

0.04167 

-0.12500 

0.0000 

0.0000 

.000 

0.000 

-5.712 

-3.0444 

0.000 

.000 

0.000 

-5.712 

0.000 

-3.0444 

0 0 

-0.0125 

0 0 

-0.0125 

0 0 

It 

CN 

3 

-0.0833 

712  0 

0.0 

0 5.712 

0.0 

— 

— — 

1 0 0 0 0 
0 10  0 0 
0 0 10  0 
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Table  6.2.  Open- loop  eigenvalues  of  the  original  system 
and  its  approximate  GHR 


Open- Loop 
system 

-0.0L947+j0. 36203 
-0.01947-j0. 36203 
-0.16678 
-0.19990 
-0.43169 
-L.98S40 
-2.0000 
-5.00000 
-5.02010 


Aggregate+residual 
sys  tarn 


-0.205975 

(A) 

-0.67422 

00 

-0.67422 

00 

-1.64300 

00 

-L. 64800 

OO 

-1.77447 

(A) 

-2.00000 

(A) 

- 3 . 04440 

(A) 

-3.17645 

(A) 

Table  6.3.  Closed-loop  eigenvalues  of  the  optimal  and  suboptimal 
regulators  for  Case  A. 


Closed  - loop 
optimal  system 

-0.17237 

-0 . 69534+jO  .3 16 15 
-0. 69534-jO. 31615 
-0.73139+j0. 27399 
-0. 73i39-j0. 27399 
-2.1223 
-2.1445 
-4.3526 
-4.3761 


Closed-loop 
suboptimal  system 

-0.27271+j0. 43602 
-0. 27271-j0. 43602 
-0.30669 

-0 . 37160+j 0.37009 

-0. 3 7 160- j 0.3 7009 

-2.0633 

-2.0738 

-4.9743 

-4.9953 
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Table  6.4.  Closed-loop  eigenvalues  of  optimal  and  suboptimal 
regulators  for  Case  B 


Closed-loop 
opcimal  system 

-0.13855 

-0.67578 

-0.67608 

-1.63910 

-1.63940 

-5 . 92460+j4 .70560 
-5 • 92460- j4 . 70560 
-5 . 92660-H4 . 70780 
-5 . 92660- j4 . 7Q7S0 


Closed- loop 
Suboptimal  system 

-0. 14132 
-0.70893 
-0.71098 
-1.57030 
-1.57030 

-5 .67730+j4. 33030 
-5 . 67730- j4 . 38030 
-5 . 68090+j4 . 38470 
-5 . 68090- j4 . 38470 
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note  even  the  closed- loop  eigenvalues  are  not  very  close  in  values,  it 

is  the  input-output  behavior  that  is  stressed  by  the  GHR  approach  to 

model  reduction.  This  is  exhibited  in  Fig.  6.1a  for  the  power  outputs 

T 

y^  and  y^  under  an  initial  condition  disturbance  of  y^ = (0.1,  0.1,  0) 

and  in  Fig.  6.1b  for  the  system  frequency  y^  under  a 10%  frequency  devia- 
T 

tion  y*  (0,0, 0.1)  . In  case  B,  because  of  the  larger-valued  weighting 

matrix  Q,the  output  deviation  from  zero  is  penalized  more,  thus  more 

control  effect  is  allowed,  resulting  a good  agreement  in  closed  loop 

eigenvalue  approximation.  The  analogous  plots  for  case  B is  given  in  Fig. 

6.2a  and  Fig.  6.2b  with  same  initial  condition  as  in  Fig-  6.1. 

Thus  far,  we  have  seen  (Table  6.2)  that  by  simply  neglecting 
2 -2 

the  coupling  ^2‘}>Z'i  between  S and  S , while  the  reduced  aggregated  model 
is  able  to  give  good  approximation  to  input-output  behavior  in  closed 
loop,  it  fails  to  predict  the  open-loop  behavior.  Next  consider  the 
compensation  of  ^2^Z2  ^ parameter  adjustment  as  indicated  by  the  RQL 
algorithm.  The  result  obtained  after  5 RQL  iterations  is  a model  charac- 
terized by  the  same  matrices  as  in  Table  6.1b  except  that  parameters  f^ 
and  f ^ in  F*"  have  been  changed  from  -3.0444  to  -0.1520.  Table  6.5 
contains  the  open-loop  eigenvalues  of  the  original  and  the  reduced  order 
model  as  well  as  the  closed-loop  eigenvalues  of  the  optimal  and  suboptimal 
regulators.  Here  we  have  assume  Q = I and  R ■ I . The  open  l^op  output 

trajectories  are  plotted  in  Fig.  6.3  for  an  initial  condition  of 
T 

yQ  - (0.1,  0.1,  0)  . Notice  the  oscillatory  behavior  of  the  full  order 
open  loop  system  is  now  retained  in  the  5th  order  reduced  model  after 
the  parameter  adjustment  by  the  RQL  algorithm.  The  closed  loop  behavior 
of  the  optimal, reduced, and  suboptimal  regulators  using  the  same  initial 
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Figure  6.1b.  System  frequency  (y3)  for  case 
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Figure  6.2b.  Sy 
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Table  6.5.  Eigenvalues  of  the  RQL  based  reduced  order  model 
and  full  order  system. 


Open- loop 
system 

Open- loop  Re- 
duced order  model 

-0.0195  + jO. 3620 

-0.0758  + jO. 4854 

-0.0195  - jO. 3620 

-0.0758  - j 0.4854 

-0.1668 

-0.1668 

-0.1999 

-2.0000 

-0.4317 

-2.1209 

-1.9884 

-2.0000 

' 

-5.0000 

-5.0201 

Closed- loop 


Closed-loop  sub- 
optimal  system 


0.1729 

-0.1827 

0.6953  + jO. 3162 

-0.49082  +j0. 4426 

0.6953  - jO. 3162 

-0.49082  - j 0.4426 

0.7319  + jO. 2740 

-0.52547  +j0. 42175 

0.7319  - j 0 . 2 7 40 

-0.52547  - jO. 42175 

2.1228 

-2.0954 

2.1445 

-2.1052 

4.8526 

-5.4971 

4.8761 

-5.5098 

163 


condition  are  plotted  in  Fig.  6.4.  Good  agreement  is  evident.  Hence  the 
RQL  processed  GHR  leads  to  a good  reduced  order  model  that  is  able  to 
approximate  both  open  loop  and  closed  loop  input-out  behavior. 

6.2  Model  Reduction  of  Pitch  Dynamic  of  Flexible  Rocket 

This  example  shows  the  simplicity  of  model  reduction  using  the 
GHR.  A 6th  order  system  representing  the  pitch  dynamic  of  a flexible 
rocket  [60]  is  considered.  In  [60],  Rogers  and  Sworder  obtained  a 2nd 
order  reduced  model  using  projection  theory  in  Hilbert  space.  Their 
procedure  involves  evaluation  of  inner  products,  solution  of  non-linear 
matrix  equations  and  use  of  gradient  search  in  order  to  obtain  reduced 
order  model  parameters,  thus  is  numerically  involved.  We  shall  attempt 
a comparison  by  showing  a second  order  model  may  be  obtain  via  GHR  using 


by: 


*1 

X2 

*3 

m 

*4 

S*5 

i x, 

l6J 

.21053 

1.0 

0 

0 

0 

0 


-.10526 

-.03537 

0 

0 

0 

0 


-.0007378 

-.000118 

0 

-605.16 

0 

0 


order 

system  of 

6ch  order 

is 

given 

0 

.0706 

0 ~ 

*1 

-7.211 

0 

.0004 

0 

X. 

-.05232 

2 

1.0 

0 

0 

0 

X3 

+ 

! 

4.92 

0 

0 

X4 

794.7 

• 

0 

0 

1.0 

xr 

0 

5 

I 

0 

3906.25 

■12.5 

0 

-448.5 

1 

and 


yml 

1.0  0 

.000334 

0 

-.007728 

_V_ 

=* 

0 1.0 

0 

0 

0 





(6.15a) 

(6.15b) 
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\ J“  (yTQy  + uTRu)dt 


(6.16) 


The  state  and  control  vectors  have  the  following  physical 


meaning : 
state  vector 


V 

- 

pitch  rate  = 9 

rad/sec 

x2: 

- 

angle  of  attack  = ot 

rad 

x3: 

- 

1st  mode  deflection  = 5^ 

rad 

V 

- 

1st  mode  deflection  rate  ■ 

rad /sec 

x5: 

- 

2nd  mode  deflection  = §2 

rad 

V 

- 

2nd  mode  deflection  rate  = ^2 

rad/sec 

control 

u : 

- 

control  deflection  = 6 

rad 

output 

yml  = 

- 

pitch  rate  mixed  with  bending  rate 

rad/ sec 

ym2  = 

- 

angle  of  attack 

rad 

A second  order  reduced  model  was  obtained  in  [60]  by  considering 
the  model  output  space  as  a subspace  of  the  system  output  space.  The 
reduced  model  parameters  were  obtained  by  invoking  the  Hilbert  space 
projection  theorem.  The  resulting  reduced  order  model  is: 


yl 

-1.415 

-0.75758 

yl 

-6.7317 

a 

+ 

y2 

0.75081 

-0.02573 

1 • 

-0.0002 

The  model  (6.17)  approximates  the  actual  system  output  (6.15b).  Using 
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chained  aggregation  of  Chapter  2,  the  6th  order  system  (6.15)  is  given 
equivalently  in  GHR  as: 


-.21053 

-.10526 

1.0 

0 

0 

0 

1.0 

-.03537 

0 

1.0 

0 

0 

1 0 

0 

-5.0461 

607.96 

-218.55 

24.852 

0 

\ 

0 

-.99644 

.12612 

-.037194 

-.0025395  . 

0 

0 

0 

0 

0 

1.0 

! o 

0 

0 

0 

-3906.3 

-12.5 

-3.4796 
-.05232 

-43.845 
-3.7314  ]u 


m 


1 0 

o 

o 

o 

o 

1 

yl 

y2 

0 1 

o 

o 

o 

o 

y3* 

_ 

1 — -J 

0 

-448.5 


(6.18a) 


(6.18b) 


We  point  that  the  GHR  (6.18)  is  particularly  simple  to  obtain.  Only  one 
step  of  chained  aggregation  is  required.  In  this  representation,  the 
substate  vector  y^  represents  the  original  system  measurements.  As  dis- 
cussed in  Chapter  4,  different  order  reduced  models  may  be  obtained  by 
neglecting  either  one  of  the  Hessenberg  blocks  F^  or  F23'  cotnPare 

with  reduced  model  of  Rogers  and  Sworder,  the  crudest  aggregated  model 
is  obtained  by  simply  neglecting  F12  in  the  Hessenberg  system  matrix-' 
without  any  compensation  by  feedback  or  parameter  adjustment.  This  is 
represented  as  a second  order  aggregated  model: 


(6.19) 


-.21053  -.10526 

-3.4796 

yl 3 

yl  + 

1.0  -.03537 

-.05232 
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Note  the  reduced  order  model  is  completely  controllable  in  this  case.  When 
F22  is  neglected,  a 4th  order  reduced  order  model  is  obtained: 


Again,  this  reduced  model  is  controllable  as  well  as  observable.  Equation 
(6.20b)  now  represents  an  approximation  of  the  actual  system  output. 

To  illustrate  the  ability  of  reduced  models  to  approximate 
open  loop  behavior  of  the  full  order  system,  the  open  loop  eigenvalues  are 

given  in  Table  6.6.  Notice  the  two  dominant  open  loop  eigenvalues  -0.12+ 
j0.31  of  the  full  order  system  are  retained  in  both  the  2nd  order  and  the 
4th  order  aggregated  model  whereas  the  open  loop  poles  of  model  of  [60]  do 
not  approximate  any  actual  system  poles.  The  open  loop  output  trajectories 
of  the  system  (6.18)  and  its  two  reduced  order  models,  i.e.  (6.17)  and 

T 

(6.19)  are  plotted  in  Fig.  6.5  for  an  initial  condition  of  y = (1  , 1)  . 
Notice  the  2nd  order  aggregate  and  the  full  order  system  have  essentially 
some  open-loop  output  trajectories  while  those  of  Rogers  and  Sworder  show 
no  resemblance  at  all. 

Next  consider  the  closed  loop  behavior.  Same  as  in  [60] , the 
objective  is  to  minimize  (6.16)  for  Q = I,  R=*l.  The  closed  loop  eigenvalues 


Figure  6.5.  Open  loop  output  trajectory  comparison  of  full  order  model  and 
2nd  order  reduced  order  models  from  [60]  and  by  GHR. 
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are  compared  in  Table  6.7  and  6.8  respectively  for  the  2nd  and  the  4th 
order  reduced  models.  It  is  interesting  to  note  that  the  closed  loop 
poles  of  both  aggregated  models  (6. 19) -(6. 20)  obtained  from  the  GHR  give 
a much  closer  approximation  to  the  optimal  closed  loop  poles  than  the  model 
by  Rogers  and  Sworder, thus  indicating  the  advantage  of  using  the  given 
information  structure  to  induce  a structurally  meaningful  reduced  order 
model.  The  closed  loop  output  responses  of  the  three  regulators  correspond 
to  Table  6.7  for  the  2nd  order  aggregated  model  are  presented  in  Fig.  6.6. 
Same  initial  condition  on  the  outputs  are  used  as  in  Fig.  6.5.  Clearly, 
a good  approximation  is  achieved.  To  compare  our  2nd  order  aggregated  mod. 
with  that  of  [60],  the  closed  loop  reduced  regulators  of  (6.17)  and  (6.19) 
are  simulated  and  plotted  in  Fig.  6.7.  One  should  compare  with  Fig.  6.6. 

Finally,  let  us  consider  the  application  of  the  GQL  algorithm  to 
the  GHR  (6.18).  Although  this  is  not  necessary  for  the  purpose  of  con- 
structing a reduced  order  model  in  this  example.  Nevertheless  it  will  demon- 
strate the  effect  of  the  GQL  algorithm  on  the  GHR.  In  particular,  the 
reduction  of  the  Hessenberg  blocks  in  magnitude  towards  a zero  matrix.  To 
this  end,  5 GQL  iterations  are  applied  to  the  initial  GHR  obtained  by 
chained  aggregation  (Eq.  6.18).  The  new  GQL  processed  GHR  is: 


-0.825 

-0.8330,’ 

-2.034  (-9) 

1.818  (-10),' 

0 

0 

0.003622 

0.7038 

0.5791' 

» 

9 .551  (-9) 

-2 .404 (-9)  ! 

0 

0 

-0.0164 

4.348 

1 

4.307  J 

-9.174 

i 

3.90  i 

i 

-0.00412 

.02563 

2+ 

-3.005(7) 

-10.13 

-9.724  ' 

1 

-16.32 

4.523  J3 

.649 (-5) 

-2. 734  (-4) 

-2.973(7) 

84.83 

1 

1 

80.29  1 

1421 

p 

1 

-3322  ! 

-36.59 

119.90 

-1.659(11) 

,-310.3 

-299.8  ; 

57.32 

-i28i  : 

-39.91 

23.82 

- 

-2.389(11) 

(6.21a) 


li* 


Table  6.7*  Comparison  of  closed-loop  eigenvalues  for  2nd  order  reduced 
order  model 


TRAJECTORIES  OF  OPTIMAL.  REDUCED  AND  SUBOPTIMAL  Y 


174 


Figure  6.6.  Closed-loop  output  trajectories  of  optimal,  reduced  and  suboptimal 
regulators  using  2nd  order  aggregated  model. 
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Figure  6.6.  continued 


output  trajectory  comparison  of  2nd  order  model 
id  Sworder  and  by  GHR. 


00*0 


Figure  6.7.  continued 
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H~ >41.6 

265.6 

0 

0 

0 

0 

-378.0 

-80.31 

0 

0 

0 

0 

(6.21b) 


From  (6.21a),  it  is  noted  that  the  Hessenberg  block  is  converging  to 
zero  much  faster  than  the  other  Hessenberg  block  F^.  In  addition,  the 
eigenvalues  of  the  leading  2x2  block  are  -0. 1229 + jO. 3124.  This  is  the 
same  as  the  2nd  order  reduced  model  obtained  directly  from  the  GHR  pre- 
viously. For  this  reason,  it  confirms  that  the  2nd  order  model  will 
suffice  as  a reduced  order  model  of  the  rocket  dynamic  with  reasonable 
output  prediction  capability. 

6.3  Decomposition  in  Decentralized  Control  Synthesis  for  a Single 
Area  Power  System. 

To  illustrate  some  aspects  of  the  synthesis  approach  considered 
in  Chapter  5,  this  example  explores  the  existence  of  a local  compensatory 
control  component  u^fa  for  the  power  system  example  considered  in  Example 
6.1.  It  illustrates  the  use  of  u^fa  to  cancel  the  interaction  F2 3Z 3 
between  the  5th  order  aggregate  and  its  corresponding  residual  so  that 
exact  dynamic  aggregation  is  achieved  in  closed  loop.  In  addition,  the  sensiti- 
vity of  the  input-output  behavior  with  respect  to  the  achievement  of  exact 
aggregation  is  studied. 

Recall  from  Chapter  5, 

Ui  “ Uia  + uib  + uic’  <6-22> 


Since  our  primary  goal  in  this  example  is  to  study  the  influence  of  u 


ib 


component,  we  assume  u^a  = u^ 


0.  From  (6.14),  to  achieve  aggregability 

2 T -2  T 

so  that  z = [z^  z 2 . ..  z^]  is  decoupled  from  its  residual  z = [z^  ...  z^] 


~ • . 
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it  is  sufficient  to  apply  a feedback  compensation  in  GHR  of  the  form: 


— — 

U-  , 

0 0 0 0 0 : -0.17507  0 00 

2 

z 

lb 

_ 

) * • • 

-2 

U2b 

0 0 0 0 0 : 0 -0.17507  0 0 

z 



— 

_ _ 

(6.23) 


Using  the  GHR  transformation  matrix  H given  in  Table  6.9  which  transforms 
(6. 7) -(6. 8)  to  (6.14),  the  compensatory  control  component  that  cancels 
the  interaction  F2 3Z 3 exPresse<^  i-n  original  system  representation  as 


— — 

___ _ 

ulb 

0 -0.33164  -0.68179  00  0 000 

u2b 

00  000  -0.33164  -0.68179  0 0 

(6.24) 


where  the  state  x^  has  the  physical  meaning  given  in  Example  6.1.  Note 
we  have  partitioned  the  state  into  two  sub-states.  The  first  substate 
is  composed  of  state  variables  of  the  first  thermal  plant  while  the 
second  sub-state  is  composted  of  states  x,.  to  x^  which  are  the  state 
variables  of  the  second  thermal  plant  plus  the  system  frequency  deviation. 
Equation  (6.24)  clearly  indicates  that  feedback  compensation  to  achieve 
aggregability  can  be  obtained  by  local  subsystem  feedback.  This  is  much 
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Table  6.9*  GHR  transformation  matrix  H of  example  6.3 


H 

0 . 00000E+00  0 . 30000E+00  0.28000E+00  0.42000E+00  O.OOOOOE+OO 
O.OOOOOt+OO  O.OOOOOE+OO  O.OOOOOE+OO  O.OOOOOE+OO  O.OOOOOE+OO 
O.OOOOOE+OO  O.OOOOOE+OO  O.OOOOOE+OO  O.OOOOOE+OO  O.OOOOOE+OO 
0. 14280E+01  -0.85332E+00  0.13533E+01  O.OOOOOE+OO  O.OOOOOE+OO 
O.OOOOOE+OO  O.OOOOOE+OO  O.OOOOOE+OO  O.OOOOOE+OO  0.14280E+01 
O.OOOOOE+OO  0. 18943E+01  0.38944E+O1  O.OOOOOE+OO  O.OOOOOE+OO 
O.OOOOOE+OO  O.OOOOOE+OO  O.OOOOOE+OO  O.OOOOOE+OO  O.OOOOOE+OO 
O.OOOOOE+OO  O.OOOOOE+OO  0.10000E+01  O.OOOOOE+OO  O.OOOOOE+OO 
O.OOOOOE+OO  O.OOOOOE+OO  O.OOOOOE+OO  O.OOOOOE+OO  O.OOOOOE+OO 


O.OOOOOE+OO  O.OOOOOE+OO  O.OOOOOE+OO  0.15000E+00 
0. 30000E+00  0.28000E+00  0.42000E+00  0.15000E+00 
O.OOOOOE+OO  O.OOOOOE+OO  O.OOOOOE+OO  0.10000E+01 
O.OOOOOE+OO  O.OOOOOE+OO  O.OOOOOE+OO  O.OOOOOE+OO 
-0. 85332E+00  0.13533E+01  O.OOOOOE+OO  O.OOOOOE+OO 
O.OOOOOE+OO  O.OOOOOE+OO  O.OOOOOE+OO  O.OOOOOE+OO 
0. 18943E+01  0. 38944E+01  O.OOOOOE+OO  O.OOOOOE+OO 
O.OOOOOE+OO  O.OOOOOE+OO  O.OOOOOE+OO  O.OOOOOE+OO 
O.OOOOOE+OO  0. lOOOOE+Ol  O.OOOOOE+OO  O.OOOOOE+OO 


r 


desired  in  practice. 


Let  us  emphasize  that  the  application  of  (6.24)  has  the  effect 
of  replacing  elements  f^6  and  f57  by  hard  zeros  in  the  GHR  (6.14),  thus 
resulting  an  exact  aggregated  model  for  (6.7) 


.2  2 2 2 „2 

z «Fz  +Gu+Wu) 


(6.25a) 


» 2 2 
7 - D z 


(6.25b) 


2 2 2 2 

Where  (F  , G , W and  D ) are  given  in  Table  6.1b.  Furthermore,  we  have 


ye  - 2 


0.28  0.42  0 


1.428  -0.85332  1.3533  0 


0 0 0.1 ’■ 

0.28  0.42  0.15 


0 1.428  -0.85332  1.3533  0 


(6.26) 


as  the  extended  output  defined  in  Chapter  5.  We  note  in  this  example, 
because  numer  of  inputs  is  less  than  number  of  outputs,  the  freedom 
component  uc  does  not  exist.  On  the  other  hand,  the  component  ufl  that 
controls  the  aggregate  may  be  sought  as  either  a centralized  or  a 
decentralized  control  by  proper  choice  of  aggregate  feedback  gain  in 


conjunction  with  (6.26).  Because  of  the  lack  of  freedom  component  u£,  the 


price  paid  in  achieving  aggregation  is  a residual  subsystem  with  fixed 


dynamics.  Its  eigenvalues  are  given  in  Table  6.2. 


To  study  the  sensitivities  of  (6.25a)  with  respect  to  uc  of 


(6.24),  (equivalently  (6.23)),  we  argue  that  the  output  trajectory  (6.25b) 


should  not  change  excessively  if  100%  compensation  is  not  achieved,  namely. 


u£  * (L  + A L)  z 


(6.27) 


is  applied  instead  of  u£  * Lz  given  by  (6.23)  is  applied.  The  application 


of  (6.27)  is  equivalent  to  replace  f^g  and  f^  of  the  GHR  system  matrix 


in  (6.14)  by  small  non-zero  numbers.  The  simulation  results  of  the  three 


output  trajectories  subject  to  complete  and  partial  compensations  are  presented 


in  Fig.  6.8a  to  Fig.  6.8c  for  u)»0  and  in  Fig.  6.9a  to  Fig.  6.9c  for  u)  equal 


to  a unit  step.  An  initial  condition  of  zq  ■ [ 1,1, 0.5,0. . .0]  is  used. 


As  a check  to  the  sufficient  condition  given  in  Chapter  5 for  the 


existence  of  a local  control  to  achieve  aggregability,  we  note  it  is 


sufficient  to  have 


[I  - (CeB)  (CeB)+] (F2Cg  - CgA)  s 0 


(6.28) 


Using  the  appropiate  matrices  Involved,  it  is  found  that 


[I  - (CeB)(CeB)+J(F5Ce  - CA) 


*~i.  r - * vT  ‘ * -r-T 

. ' ' ' ■ 


mm 


in  GHR  system  matrix,  u>«unit  step. 


189 


0 

0.00004 

-C. 00002 

0 

0 

0 

-.000005 

0 

0 

0 

0 

-.000005 

0 

0 

.000004 

-.00002 

0 

0 

0 

0.000001 

-.00003 

.000001 

0 

.000001 

-.00003 

.000001 

.000001 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

which  for  practical  purpose  can  be  considered  zero.  Hence  the  output  follow- 
ing conditions  are  satisfied,  and  local  feedback  u^c  exists  as  confirmed  by 
(6.24). 

6.4  Decomposition  in  Decentralized  Control  Synthesis  for  a Two  Area 
Interconnected  Power  System. 

This  example  will  illustrate  the  full  capabilities  of  the  control 
synthesis  considered  in  Chapter  5.  A two  area  power  system  with  each  area 
containing  two  thermal  plants  is  constructed  from  [59] . The  system  is 
mode 1 by 

x ■ Ax  + Bu  + E <d  (6.29a) 

y - Cx  (6.29b) 

19  4 2 3 

where  x£R  ,u£R,uj6R  and  y£R  . The  state,  control  and  outputs  have 
the  following  physical  meanings: 

Xl*  X12  * va*ve  position  displacement  in  first  thermal  unit  of  area  1 and  2. 

x_,  x..  ■ power  output  displacement  of  HP  turbine  in  first  thermal  unit  of 
area  1 and  2. 

XV  xia  “ power  output  displacement  of  IP  turbine  in  first  thermal  unit  of 
area  1 and  2 . 

X4’  X15  * Power  output  displacement  of  LP  turbine  in  first  thermal  unit  of 
area  1 and  area  2. 

x5’  X16  * v*lve  position  displacement  in  second  thermal  unit  of  area  1 and 
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h 


V 

X17 

V 

X18 

V 

X19 

V 

XH 

x10 

V 

U3 

U2* 

u4 

u>^» 

“2 

of  area  1 and  2. 


power  displacement  of  IP  turbine  in  second  thermal  unit  of  area 
1 and  2. 


power  displacement  of  LP  turbine  in  second  thermal  unit  of  area 
1 and  2. 


x^,  ■ frequency  deviation  of  area  1 and  2. 

tie- line  power  flow  connecting  area  1 and  2. 


y^  * frequency  deviation  of  area  1. 

y^  m tie- line  power  flow  of  area  1 and  2. 


y^  * frequency  deviation  of  area  2. 


The  system  matrices  (A,B,E,C)  are  given  in  Table  6.10.  Apply  first  the 
chained  aggregation  procedure  of  Chapter  2 to  bring  (6.29)  into  the  GHR 


Fz  + Gu  + W 


(a 


Dz 


(6.30a) 

(6.30b) 


where  the  GHR  system  matrices  (F,G,W,D)  are  given  in  Table  6.11  while  the 
GHR  transformation  matrix  H is  given  in  Table  6.12.  The  GHR  structure 
indicates  6 subsystem  (GHR  subsystems)  of  dimension  3, 2, 2, 2, 2, 8 after 
five  steps  of  chained  aggregations,  i.e. 


1 


Table  6.10.  Sy3tem  matrices  (A,B,E,C)  of  Example  6.4 
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Table  6.11.  GHR  representation  (F,G,W,D)  of  Example  6.4 


©oooooooooooooo©© 


0000000000009090 


O r*. 

0000900000000000  • • o 

irt  <o 


o o o o o o o 


OOO^^OOOO 


ooooooooooo 


90000000000 


ooooooooo 


©OOOOOO  — ©0»O 


ooooooooooo 


oooo  — o • o 


000  — 0 *ooooo 


oo  — o *ooooo 


0-000-0-00 


5 • m 

• o — o — ooo 


— o o o ** 


oooo  • o o © 


— 000^*00000*^0000000 


— n 

— in 

flgflgOOOOOOOOO 


o o o o o 


Table  6.12.  GHR  transformation  matrix  H of  Example  6.4 
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F, , 

F,„ 

0 

0 

0 

0 

0 

w. 

11 

12 

1 

F21 

F22 

F23 

0 

0 

0 

0 

0 

F31 

P32 

F33 

P34 

0 

0 

G3 

0 

F41 

F42 

F43 

P44 

F45 

0 

G - 

0 

w - 

0 

FS1 

P52 

F53 

P54 

P55 

0 

0 

0 

F61 

P62 

F63 

F64 

P65 

F66 

G6 

0 

(6.31) 


From  the  structure  of  F and  G in  (6.31),  it  is  clear  that  one  possibility 
to  achieve  aggreability  is  to  use  feedback  so  that  F^  ^z^  is  fully  com- 


pensated. Thus  a 7th  order  aggregated  model  of  the  system  is  desired. 


P11  P12  0 
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W 

1 

F_.  F„ « F„. 

z + 
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u + 
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P31  F32  F33 

G3 
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€ R 


(6.32) 


y - [I1  0 0]zr  , y € R“ 


where  the  system  matrices  of  (6.32)  (Fr,Gr,Wr,Dr)  arc  given  by  Table  6.13. 

Recall  u . *u,  + u..  +u.  where  u.  is  used  to  control  the  aggre- 
i ia  ib  ic  la 

gate  (z3  in  this  case),  utb  is  used  to  achieve  aggregation  (compensation 


_ 3 

of  F.,  , z,)and  u.  is  used  to  control  the  residual  (z  in  this  example). 
3,4  4 ic 


Let  us  initially  consider  the  design  of  u..  in  GHR.  Denote 


“lb 


bi 


• S’ 


(6.33) 


Note  that  due  to  the  structure  of  G,  can  have  a general  form: 


r 
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Table  6.13  System  matrices  (F^,  Gr,  W^,  D^)  of  the  reduced  order 
aggregated  model  (6.32). 
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a V 

b -Y 

°4x7 

c <* 

°4xl0 

-c  8 

— 

where  a,b,c,a, 8.Y  *re  arbitrary  parameters  as  long  as: 

.2375 (a  + b)  - -1 
.2375(a  + 3)  - -1 
One  possible  can  be 


H- 


4x7 


-2.105263 

-2.105263 

0 

0 


0 

0 

-2.105263 

-2.105263 


4x10 


Expressed  in  terms  of  original  system  variables,  is 

“b  " V ’ V*  “ ho* 


(6.34) 


(6.35) 

(6.36) 


(6.37) 


(6.38) 


where  is  given  in  Table  6.14.  Again  we  see  a local  feedback  structure 
exists  for  ^ in  order  to  achieve  aggregability.  With  the  application  of 
given  by  (6.38),  (6.32)  is  now  an  exact  reduced  order  model  of  the 
power  system  (6.29). 

Next  consider  the  design  of  u^  which  controls  the  aggregate.  For 
simplicity,  assume  u>"o.  An  optimal  regulator  design  is  used  to  control 
the  aggregate  (6.32).  The  quadratic  cost 


CO 

J ■ T f * TQ  Z + uj  R u dt 

4 *jo  r r a a 

is  optimized  with  Q-9I,  R«I.  The  result  is: 


(6.39) 


1 1 ~ ^ * f ' ! >\ 


•J 


200 


.87991 

-11.066 

10.714 

-3.5577 

2.9453 

-3.7568 

1.4842 

.87991 

-11.066 

10.714 

-3.5577 

2.9453 

-3.7568 

1.4842 

.87991 

10.714 

-11.066 

2.9453 

-3.5577 

1.4842 

-3.7568 

.87991 

10.714 

-11.066 

2.9453 

-3.5577 

1.4842 

-3.7568 

L**r 


(6.40) 


Hence  Che  component  Co  be  applied  co  (6.30)  is 


ua  - [l;  o] 


■ L z 

a 


(6.41) 


Ue  pause  Co  stress  the  importance  of  component  uft  in  this  example.  It  is 
interesting  to  note  that  the  open  loop  system  of  (6.30)  (u  so)  is  stable. 
On  the  other  hand,  if  of  (6.38)  is  applied,  the  resulting  system  is 
unstable.  However,  with  the  application  component  ua,  the  new  closed  loop 
system  is  again  stable.  The  eigenvalues  are  summarized  in  Table  6.15. 
Adopt  the  notation: 


I 

II 

III 


» u "0 


ua  - 0,  ub  + 0,  u 
Ua  f 0,  u^  + 0,  u 


0 

0 


(6.42) 


The  output  trajectory  behavior  (frequency  deviations  of  areas  1 and  2 and 
tie- line  power  flow)  are  plotted  in  Fig.  6.10  for  a initial  condition  of  zq« 
(0,0.5,0,...0)  which  corresponds  to  a frequency  variation  in  area  1. 

Similar  to  Example  6.3,  the  sensentivity  of  output  trajectories 
with  respect  to  the  component  u^  is  studied  via  simulations.  Again  the 
perturbation  of  u^  are  expressed  in  terms  of  small  perturbation  of  fgg 


i i i ii 
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Table  6.15.  Eigenvalue  comparison  when  u and  u are  applied 

c l D 


«»c 

1 

a 

c 

o 

I 

o 

V°*V*0'  uc  * 0 

ua*°,  ub#0,  uq  - 0 

-2.0 

-2.0 

-2.0 

-0.1667 

-0.1667 

-0.1667 

-2.0 

-2.0 

-2.0 

-0.1667 

-0.1667 

-0.1667 

-5.0 

-5.0 

-5.0 

-0.2 

-0.2 
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-1.457 

-0.04723+ j 1.943 
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-0.675 
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1 

Figure  6.10.  continued 


re  6.10.  continued 
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and  f,Q  of  the  system  matrix  F in  the  GHR.  Simulation  results  for  u * 0, 
u^  # 0,  uc  * 0 are  plotted  in  Fig.  6.11  where  (I ) represents  f^g  » f^^ 31  1.0, 
(II)  represents  f6Q»f79*1.5  and  (III)  represents  f6g*f79*1.2.  Those 
for  ua  j*  0,  u^  i*  0 and  u^.  » 0 are  plotted  in  Fig.  6.12  where  (I)  represents 

f68*f79*1,  rePresents  f68  ” f79  “ °*5  rePresents  f68  ” f79  = -1 -0, 

(IV)  represents  f gg  * f 79  * 0 and  (V)  represents  ffig * f79  * 2.5.  Even  when  a 

fairly  large  perturbation  in  is  introduced,  the  sensitivity  of  the  out- 


put trajectory  with  respect  to  u^  is  not  severe. 

Finally,  let  us  illustrate  the  existence  and  utilization  of  the 
freedom  component  u^  as  discussed  in  Chapter  5.  For  this  example, 
m"4>r“3.  Thus  freedom  should  exist,  resulting  a non-interactive  control 
of  the  residual  subsystem  in  the  GHR.  From  (6.31),  we  see  it  is  sufficient 
to  restrict  uc  to  lie  in  the  null  space  of  Gg  where 


G 


3 


0.2375 

0 


0.2375 

0 


0 

0.2375 


0 

0.2375 


(6.43) 


Thus  u^  takes  on  the  general  form: 


u 

c 


[0  0 0 


(i4-g3  g3)k] 


“ L z 
c 


(6.44) 


Where  K is  an  arbitrary  matrix  and  z^  are  the  substates  of  the  GHR  parti- 
tioned in  accordance  with  (6.31).  Introduce  the  notations 
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K - [ktJ]  , ktj  £R 

®J  " kii  " k2J  ’ 1 " lf  2 ’ 3’  4 

0j  ■ “ k^j  » jal,  2,  ...  12 


(6.45) 


Then  it  can  be  shown  chat 


u -0.5 
c 


-«1 

Of-  _ f 


(6.46) 


To  guarantee  a local  feedback  structure  in  the  original  system  represents' 
tion  (6.29),  using  the  relation  z-Hx,  it  is  sufficient  to  have 


«2  " *4  " a9  * “10  " “11  * a12  “ ° 

*1  " *3  " h “ h " h " h " 0 


(6.47) 


which  gives  a K of  the  general  form: 


0 k13  0 k15 


^16  k17  k18  ° 


0 k25  k26  k2?  k2a 


0 k34  0 

0 k^  0 


o v v k 

u k39  3,10  3,11  3,12 
0 V v Ic  Ic 
u 49  4,10  k4,11  4,12 


(6.48) 


Hence  if  no  local  feedback  constraint  is  imposed,  the  matrix  can  be  choosen 
arbitrarily  in  generating  the  freedom  component  u^  in  control  synthesis. 
However,  if  local  feedback  (i.e.  area  i control  u^  uses  only  state  variables 
from  area  1)  is  imposed,  K must  be  chosen  according  to  (6.48).  To  show 
the  eigenvalue  shifting  capability  of  uc,  the  closed  loop  eigenvalues  under 
u^-L^z,  u^-L^z,  u£  - 0 and  ua-Lftz,  ub“Lbz>  “c  * kcz  are  obtained  where 
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Lc  Is  the  feedback  gain  correspond  to  kn"k32«-2,  k2i"k42*2*  k13“k34*_5» 
k23"k44*5-  These  are  given  in  Table  6.16. 

In  suxmnary,  we  note  the  control  u^,  1*1,2  consists  of  three 
components.  The  first  component  u^a  controls  the  aggregate  (6.32).  In 
terms  of  actual  physical  system  variables,  u^a  may  be  designed  and  imple- 
mented either  as  a centralized  control  or  as  a decentralized  control.  The 

second  component,  ((6. 38))  achieves  aggregation  by  canceling  the 

3 -3 

Interaction  between  S and  S , and  is  seen  Implemented  as  a decentralized 

control  (see  Table  6.14).  The  third  component  u^c  given  by  (6.44) 
offers  an  freedom  component  that  is  non-iteractive  with  u^a  and  and 

controls  the  aggregate.  Again,  it  can  be  implemented  either  as  a 

centralized  or  as  a decentralized  control  in  terms  of  actual  power  system 

variables.  We  have  chosen  a decentralized  implementation  in  the  example. 

Finally,  we  note  that  the  output  trajectories  under  ua  and  u^  given  in 

Fig.  6.10  shows  considerable  damping  as  compared  to  those  in  actual  practice. 

This  is  because  in  forming  ua,five  states  (all  states  of  the  aggregate 

(6.32))  are  utilized  for  feedback  while  in  reality,  only  available  outputs 

are  used  to  generate  the  feedback  control. 
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CHAPTER  7 
CONCLUSION 

The  construction  of  reduced  order  models  of  a linear  time 
invariant  system  by  dynamic  aggregation  is  studied.  The  relationship 
between  aggregation  and  observability  is  given.  It  is  shown  that  given  the 
pair  (A,C)  where  A is  the  system  matrix  and  C the  aggregation  matrix  (C  is 
assumed  to  be  the  output  matrix).  Three  cases  can  occur:  (A,C)  completely 
aggregable,  (A,C)  aggregable  and  (A,C)  nonaggregable . When  (A,C)  is 
completely  aggregable  or  aggregable,  (A,C)  is  also  unobservable.  When  exact 
aggregation  occurs,  the  aggregated  model  is  the  model  of  the  system  in  the 
observable  subspace  defined  by  (A,C). 

The  extension  of  Aoki's  aggregation  method  results  in  the  chained 
aggregation  procedure  which  leads  to  the  generalized  Hessenberg  system 
representation.  The  properties  of  the  GHR  are  studied.  It  is  shown  that 
the  GHR  structure  is  a property  of  the  pair  (A,C).  In  addition,  the  observ- 
ability and  controllability  properties  of  subsystems  in  the  GHR  structure  are 
examined.  One  important  feature  of  the  GHR  is  its  use  for  the  construction 
of  approximate  aggregated  reduced  order  model  of  the  system.  In  the  crudest 
form,  this  corresponds  to  neglecting  certain  Hessenberg  blocks  in  the  GHR 
system  matrix  without  any  parameter  adjustment.  The  effect  of  the  Hessenberg 
blocks  in  introducing  approximation  error  between  actual  system 

output  and  approximate  system  output  is  studied  both  from  trajectory  pertur- 
bation and  from  open-loop  eigenvalue  perturbation  point  of  view.  The  pertur- 
bations are  approximately  bounded  in  terms  of  the  perturbing  Hessenberg  block. 


I 
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If  none  of  the  Hessenberg  blocks  can  be  considered  weak  and  thus 
be  neglected  at  the  outset.  The  coupling  i+^zi+^  between  the  aggregate 
and  the  residual  subsystem  must  be  adjusted  accordingly.  Several  methods 
are  presented  in  Chapter  4.  One  of  ;he  major  methods  proposed  is  the  GQL- 
RQL  algorithms.  The  GQL  theory  is  developed  in  Chapter  3 giving  mainly  its 
properties,  convergence  and  effects  on  the  GHR  system  representation.  A 
specialization  adopted  for  our  reduced  order  modeling  via  the  GHR  results  in 
the  RQL  algorithm.  The  robustness  of  using  a selected  reduced  order  model 
in  designing  control  laws  for  the  actual  system  is  studied.  Two  approaches 
are  used.  In  the  first  one,  a Lyapunov  function  is  introduced  and  then 
bounded  in  terms  of  the  perturbing  Hessenberg  blocks.  In  the  second,  a 
frequency  domain  condition  is  obtained  guaranteeing  the  stability  of  control 
law  designed  based  on  the  reduced  order  model. 

Finally  the  synthesis  of  a decentralized  control  for  an  inter- 
connected system  is  studied.  The  conditions  under  which  the  system  inter- 
connection variables  may  track  a system  of  reference  interconnection  dynamics 
are  obtained.  The  solution  is  shown  to  be  related  to  the  capability  of 
achieving  aggregability  by  using  compensatory  feedback  control.  Moreover, 
the  local  control  u^  can  be  decomposed  into  three  basic  components,  one  to 
control  the  aggregate,  one  to  achieve  aggregation  of  some  variables  containing 
the  system  interconnection  variables,  and  one  for  controlling  the  residual 
if  it  exists.  This  third  component  is  shown  to  be  dependent  on  the  system 
structure  and  only  exists  when  number  of  inputs  are  greater  than  the 
number  of  outputs.  Several  examples  using  typical  large  scale  systems  as 
bench  mark  models  are  given  to  illustrate  the  methodology  proposed. 
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In  summary,  it  is  demonstrated  that  ’’good”  reduced  order  models 
that  approximate  the  input-output  behavior  of  a large  scale  system  can  be 
obtained  by  taking  into  account  the  given  output  information  structure  in 
defining  a reduction  procedure.  The  GHR  approach  to  model  reduction 
provides  both  a simple  and  systematic  means  of  obtaining  reduced  order  model 
structures  and  parameters.  However,  the  implication  of  weak  coupling  and 
weak  observability  of  the  residual  by  the  aggregate  subsystem  must  be  given 
future  attention.  In  addition,  the  relationship  between  the  GHR  structure, 
the  obtained  reduced  order  model  and  the  stability  of  control  law  based  on 
the  reduced  order  model  in  stabilizing  the  full  order  system  must  be  under- 
stood. Finally,  the  decomposed  control  problem  in  terms  of  hierarchical 
control  and  parallel  computations  requires  additional  studies  in  order  to 
realize  its  full  potential  as  a viable  methodology  to  solve  a large  scale 
system  problem  efficiently. 

A complete  computer  software  has  been  developed  for  the  chained 
aggregation  procedure,  generalized  and  restricted  QL  algorithms  and  for  the 
simulation  of  the  three  regulator  designs  described  in  Chapter  5.  A docu- 
mentation may  be  found  in  [13]. 
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APPENDIX  A 

PROOFS  OF  THEOREM  2 . 9 AND  COROLLARY  2 . 9 


Proof  of  Theorem  2.9 

For  notational  simplicity,  all  subscript  and  superscript  "i"  in 
(2.21)  will  be  omitted.  In  addition,  introduce  the  following  notations: 


i - i « *1  » -i 

x^  m z , x2  z , x^  =*  z , X2  * z 


I 

i 

1 

i 

IjFll  -m1. 

!|El|*m2, 

I|gI|  «m3 

llH(!  -m5. 

l|*ll  *n4. 

nail  »m6 

IV  ‘V 

"X20" 1 2 

Qfi  (t-T) 

l(0(t,T)lt  < px  e 

pl  >0, 

p^,  € R 

Of? (t-T) 

,i0(t,r)ll<p2  e 

P2  >o. 

o2 » a2  6 R 

(Al) 


(A2) 


where  0(')»  0(‘)  are  the  state  transition  matrices  for  F and  F respectively. 
Note  also  no  sign  definiteness  is  assumed  on  and  <*2  except  they  are 
constants.  Define 


e (t)  - xL(t)  - x^t) 


(A3) 


then 

e - Fe  + E x2  (A4) 

e (0)  ■ 0 
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j£a. 


Integrating  (A4) , we  have 

e (t)  = rC  0(t  - t)  Ex2(T)dt  (A5) 

o 

Using  (2.56a),  (2.57b)  and  (A3),  we  get 

x2(t)  =0(t,o)x2O+J^  0(t,T)  He(T)dT+J*  0(t,T)  HxL(T)dT 


+ f1"  0 (t , t)  G u(t)dT  (A6) 

J o 

and 

x^t)  3 0(t,o)x1Q+J^  0 ( t , t ) G u(T)dr  (A7) 

Taking  the  instantaneous  norm  of  (A5)  - (A7), 

lie (t)l|  H 0(t , o) ||  II  El|  |l  x2(T)!|dr  (A7a) 

l|x2(T)!|  < l|  0 (t,o)  II  |Ix2qI'  + II  0(t,ct)  '|  Hh|I  lie  (ct)  II  d a 

+ Jo  " ^ (T*a)!'  "H!!  !l*i/a)"d<*  (A7b) 

+ lo  N 'I  "Gil  "u(a)'l  d a 

'lx^(a)l|  < ||  0 (a,o)  (|  (fx ^^{1  + II  0(ct,  s)  II  IlGlj  l|u(s)  ||ds  (A7c) 


After  some  tedious  algebraic  manipulation  and  integration  and  using  (Al) 
- (A2),  we  arrive  at: 


Qf.t 


or0t 


e(t)H  < KL(t)e  1 + K2e  2 +K3  - 


m2plp2m5  a2C  Pt„  , -V  . 

. e . I m e (t)  I'e  dT 
(o',  - <x, ) ° o 


O',  T 


m0p.  o0m  Of.  t 

+ -?-4  e 1 . rC  |!  e (t)  !|e  1 

(or i - a/2)  Jo 


dT 


(A8) 


— a Mi 
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where 


Kx(t) 


m2plm51IP2 

, m2plp2m3in5K 

“2Vlp2 

(al-a2) 

cr-j^ - a2) 

(a1-a2) 

2 . 

m2  plm5^1P2 

m2p?p2m3m5K  , 

m2pim6Kp2 

(a^  - a2)2 

* ( ^2 

Oj  (a^  - a2 ) 

a2(al  " “2^ 

m2plm6Kp2 

m2p2p2m3m5K 

2 

m2Plm3m5P2K 

“l^ 

+ 2 
ala2 

“l«2  (al  _Qf2 } 

K j + t 

2 r, 

m2Plm5T'lP2 

m2\Plp2  . m2 

PlP2m3m5K 

(o^  - a2)2 

" (°l-a2)  ^ 

(a^  - o2)2 

m2Plm6Kp2 

2 

m2Plm3m5p2K 

a2(o;1  - a2) 

«ia2(«i  ' <*2> 

ra2plp2m6K 

2 

m2plP2m3m5K 

ala2 

2 

a,  a. 

(A9a ) 


(A9b) 


(A9c) 


The  following  Lemma  known  as  the  Gronwall's  lemma  is  required  for  the 
subsequent  derivation. 

Lemma  [16]  Let  \(t)  be  a real  continuous  function  and  y,(t)  a nonnegative 
continuous  function  on  the  interval  [a,b].  If  a continuous  function  y(t) 
has  the  property  that 


y(t)  < \(t)  + m,(s)  y(s)ds 

for  a<t<b,  then  on  the  same  interval 


(A10) 


MMi  iMMftMiHMMi 
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y(t)<\(t)  + J*  \(s)  p,(s)  exp  (J’gM,(T)dT)ds  (All) 


In  particular  if  \(t)  s\  is  a constant 


y(t)  < X exp  ( J^p,(s)ds), 


(A12) 


Next  let  us  define 


or  ■ max  (ar-^,  c*2) 


(A13) 


m2plp2m5 


> 0 


(A14) 


A closer  examination  of  (A8)  indicates  that  two  distinct  cases  exists 


Case  I : (ar^  - or2)  > 0 


Dropping  the  negative  terms  in  (A8)  and  using  (A13)  - (A14) , we 

have 


l|e(t)||<K1(t)e*t+  K2eot+  K^e0^  .J*  |le(T))le  T dr 


(A  15) 


De  f ine 


w(t)  = !le(t)l|e 


■or  t 


(A16) 


then 


w(t)<K1(t)+K2  + K^e  a C + w(T)d-r 


(A17) 


Defining 


X(t)  - Kj(t)  + K2  + K3e 


■at 


(A18) 


■f"  1 r- 


- m I 
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We  may  apply  Gronwall’s  Lemma  to  (A17)  which  yields  upon  integration 

w(t;  < K{+K2+K3e'a,:+  (Kj+ye^+^KJ  c + t^2_(eU  t _ -or  t } 
or  equivalently  after  post  multiply  by  and  regrouping,  we  finally  get 

ii  „ K3a  , «t  (KJ  +K-  +K,)p,2  + (K'Q'  + K_0'  + K',)p,  + K"  a , x 

'hcoll^rrv  + (k;  +K-)eat+  — ± — £ 1-L i 2 i_I L_e(^+cy)' 

a ^ 1 * n(C*  + y,) 


(A19) 


Case  II:  (<*1  * <*2^  < 0 


Dropping  negative  terms  in  (A8)  and  using  (A13)  - (A14),  we  again 


e(t)l|<K1eaft+  K2eat+  K3+^eatj‘  ||e  (t)  |le  '<*  T d t 


Consequently,  (A19)  also  holds. 


Proof  of  Corollary  2.9 


Starting  from  (A8)  and  following  similar  procedure  as  in  the 
proof  of  Theorem  2.9,  we  can  show 


Case  1 1 : - <*2)  >0 


..,el||,  VL+  <*i+*2**3>»  + (K{«+K2ofHcplt+Kj'<>  g(o ,^)t 

" a + U 1 2 n(a  + n) 


(A20) 


where 
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Kt  * Kj  + K£  t 


V\  H-  o1  m3K 


nu 


a2^ 


+ M-  PL  T]1  t 


(A21a) 


M>  Px  \ u®6K  |iP1n3K 
K2  ai~a2  a2m5  ala2 


(A21b) 


k3  - k3 


(o^  - 0(2^m6  K ^ Pj  m3  K ' ar2) 


ala2m5 


al°2 


(A21c) 


Case  II1  : (c^  * ofj)  <0 


K3a 


e(t)IU  +(K{+K2)eat  + 


(K^+K^  )p.2+(K{of42^'V+K"a 


M-(Qf-Hi) 


(QH^)t  (A22) 


where 


Kx  - K|  + K^'  t 


y P1m3 


m„K 


m,K 


Hm6 


a2(ai  ~ a2^ 


m5  a2 


Mi  Pt  m3K 


a. 


(A23a) 


. g.  *n2  M-  Pi  \ 

2 m5  (ofj  - df2 ) 


(A23b) 


K3-K3 


m2  pj  m6  K p2  m2PlP2m3m5K 


ala2 


ala2 


(A23c) 


Under  the  assumption  of  F,  F stable,  a^<0,  1*1,2,  thus  q;<0.  Equations 
(A20)  and  (A22)  immediately  give  the  conclusion  of  Corollary  2.9. 
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APPENDIX  B 

PROOF  OF  THEOREM  2.10 


Define  the  quantity 


hi  m hiAc*i 


i,j  *I,2,...n 


X_1A  X - X_1(A  + 4 A ) X 

c c c 


- diag  (\v  \2  ...  \n)  + [3tj]  (B2) 

A 

Apply  Lemma  2.3,  we  conclude  X lies  in  disc  with  center  X^ + (3^  and 

radius  £ | @ | . Since  eigenvalues  of  A are  distinct  by  assumption,  there 
j*i  J C 

exists  distinct  €■  neighborhoods  of  such  that  X^  lies  within  this 
6- neighborhood.  If  the  radius  of  the  i-th  disc  can  be  reduced  so  as  to 
isolate  it  from  the  rest  of  the  Gorschgorin  discs,  X^  may  be  determined 
within  the  isolated  disc. 

Consider  the  isolation  of  the  i-th  Gorschgorin  disc  from  the 

rest.  To  reduce  the  radius  r.  “ £ | 0.  , | , let 

1 jl*i  ij 


0 0 


€i  ° 
0 I 


, €t«  1 


be  a linear  transformation  Co  be  applied  to  the  right  hand  side  of  (B2). 
Thus  the  eigenvalues  remain  invariant.  Then 


Ac  ~ diag  (X1,...X0  ) + Tt  3Tt 

where  ~ denotes  equivalency  in  terms  of  linear  transformation  on  k^. 
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T serves  to  modify  the  radius  of  the  Gorschgorin  discs.  is  chosen 
so  that  the  radius  of  the  i-th  disc  is  reduced  as  much  as  possible  while 
keeping  the  radii  of  other  discs  sufficiently  small  to  avoid  overlapping 
with  the  i-th  disc.  Pictorally,  this  is  illustrated  by  the  following 


ri“  l€t  |z  I eik! 

k^i 


Vlfl+E|ejk| 

ei  kf*J  J 


Xi  + *ii 


XJ  + 

. J * i 


Fig.  Bl.  The  effect  of  T.  on  the  i,  j-th  Gorschgorin 
disc. 


Notice  while  the  radius  of  i-th  disc  is  reduced,  the  radii  of  other  disc  inc 
increases.  From  Fig.  Bl,  we  observe  is  to  be  chosen  such  that 


l|fl IsjJ  s»tl«i  + 6u)-<V6jj>!  V),‘1  <B5> 


l€i!  S |Sikl  < (1-pi)I(X1  + 0ii)-(Xj+0jj)|  Vj>»i  (B6) 

where  0 < < 1. 

The  implication  of  (B5)  - (B6)  is  made  clear  by  combining  the  equations  into 

1^1  +k^l8Jkl  + IStl^lStk1  <lftl  + Bu)-aj  + 9jj)| 


Vj  * i (B7) 


(B7)  says  r^r^  <d^  V j f i where  rt  is  the  radius  of  the  i-th  disc  and 
dj ^ is  the  distance  between  the  centers  of  the  i-th  and  j-th  discs.  The 
existence  of  such  an  6^  guarantees  the  isolation  of  the  i-th  disc  from 
the  rest  for  the  chosen  value  p^.  From  (B5),  it  is  necessary  to  choose 
so  that 


2 |PJkl 

kfj 

k?*i 


nn  i 

-rs : r p±  < f 

J ‘(xi  + 0ti) " (xj  + 0jj)' 


If  (B8)  is  satisfied,  for  a fixed  p is  chosen  such  that 


|€.  > max 

* x 


lt  »ildi  + su>-<VBjj>|-jjls)k| 

k^i 

(i-pi)|di  + eti)-di  + e..)|  _ 


The  interval  of  existence  of  € is  illustrated  by  Fig.  B2 


Interval  of  existence  of 


Fig.  B2  Interval  of  existence  of  € 


It  is  obvious  that  6^  exists  if  and  only  if  ^ • Assuming  this  is 
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APPENDIX  C 


PROOF  OF  THEOREM  4.1 


Taking  time  derivative  of  (4.48)  and  evaluating  along  (4.45),  we 


*1(4.45)  + 

- zT(FTP  + PF  )z  + 2zTAFTPz 
c c 

T T T 

* - z Qz  + 2 z 4F  Pz 


T 4FTPz  < ||s||  I!  AFT!|  II  Pzll  < II  4 Fll  II  pl|  Jlzll2 


1 * 4 W 
0<!Uf.|4 

max 


Using  the  fact 


'll.  * lw 


(x2  <p)ll/2 

max 


\ (P) 

max 


then  (Cl)  becomes 


zT  4 FPz  < r 1 (Q)  II  zl|2 

~ *■  min 


which  implies 
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v|  < -zTQ  2+  \ (Q)|l  z II2 

(4.45) 

< 'zT  tQ  • WQ)  * 11  2 

Hence  v < 0.  It  is  easy  to  see  v P 0 along  any  non-zero  trajectory  of 
(4.45).  Thus  stability  follows 


ai 
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JL._ 


APPENDIX  D 
PROOF  OF  THEOREM  4.3 


Recall  the  definition  of  R(M)  from  (4.57),  expanding  the  right 
hand  side,  we  obtain 


R<«>-“tF022+Fo21Q'lpF012’+  'F022  +Fc21Q'lpr012'TM 


+ MFC21Q'‘F=21M  + FJuFQ'lpF0l2 


(Dl) 


Define 


-1 


F * F022  + Fc21Q  PF012 


5-Fc21Q‘lpc21 


(D2a) 

(D2b) 

(D2c) 


Then  (Dl)  may  be  rewritten  in  simplier  form: 


R(M)  - MF  + F M + MSM  + Q < 0 


(D3) 


Let  us  examine  first  the  equality  instead: 


R(M)  - MF  + P M + M~S  M + Q - 0 


(D4) 


Notice  the  requirement  of  a positive  definite  and  symmetric  solution  to 
(D4)  is  equivalent  to  asking  if  there  is  a negative  definite  and  symmetric 
solution  N * -M  to 


- T , 


RX(N)  ■ NF  + F N-NSN-Q*  0 


(D5) 


. 
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(D5)  is  a Riccati  equation.  Thus  the  initial  requirement  of  a M>0  with 
R(M)  < 0 is  equivalent  to  guaranteeing  the  existence  of  a N<0  such  that 
R^(N)  >0.  It  turns  out  that  the  existence  of  a N<0  such  that  R^(N)  >0 
is  related  to  the  existence  of  a N^<0  such  that  R^(Np  *0.  In  order  to 
facilitate  the  proofs,  the  following  lemmas  will  be  required: 

Lemma  Dl  [48] 

Consider  the  algebraic  Riccati  equation 

KA  + ATK  - KBBTK  - CTC  - 0 (ARE) 

If  (A,  B),  (A,  C)  are  completely  controllable  and  completely  observable 
respectively  and  Re  \ (A)  <0  (where  Re \(')  means  real  part  of  eigenvalue 
\).  Then  there  exists  a real  symmetric  solution  K to  the  (ARE)  such  that 
Re  \(A  -BBTK)  < 0 if  and  only  if 

I - BT(-ji)I  - A1)'1  CTC(jouI  - A)_1B  >0  V real  (u  (D6) 

Moreover,  such  a solution  K is  unique,  negative  definite  and  symmetric. 

T 

Unfortunately,  Lemma  Dl  only  guarantees  Re  \(A  -BB  K)  <0. 

Lemma  D2  strengthens  the  results  of  Lemma  Dl. 

Lemma  D2 

Under  the  assumptions  of  Lemma  Dl,  then  there  exists  a unique 
negative  definite  and  symmetric  solution  K to  the  (ARE)  such  that 
Re\(A-BBTK)  < 0 if  and  only  if 

I - BT(-jouI  - A1)'1  CTC(jcoI  - A)'1  B>  0 (D7) 


V real  u). 
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Proof:  Rewrite  (ARE)  as 

ATK  + KA  - kbbtk+q  » 0 
o 

T 

where  Q ■ -C  C.  By  hypothesis,  (A,B)  is  controllable.  Theorem  6 of 

Monilari  [49]  states  if  there  exists  a F satisfying  Re  (A  - BF)  <c  0,  then 

+ T + 

there  exists  a solution  K of  (ARE)  such  that  Re  \(A  -BB  K ) < 0 if  and 
only  if 

0p(juj)  * [I  * F ( - j ujl  -A)  1B]T[BT(-jauI  - AT)’1QQ(j  ^ I -A)_1B  + I]  [I-F(jcoI-A)1B]>0 

(D8) 

for  all  'ju  . Since  Re  \(A)  < 0 by  assumption,  it  is  sufficient  to  take 
F*0.  In  addition,  from  Remark  13  of  Willems  [48],  if  Qq  = -CTC,  all 
solutions  to  the  (ARE)  are  negative  definite,  thus  K = K+<0.  Apply  (D8) 
with  F =0,  we  conclude  Re  \(A  -BB^K.)  < 0 if  and  only  if 

0o(jto)  ■ I - BT(-jmI  - AT)'1CTC(jU)I  -A)'LB  >0  Vcu 

This  proves  the  lemma. 

Lemma  D3 

Consider  the  quantity 

H(oj)  * BT(-jujI  - AT)  ^ (jcuI-A)  1 B Vtu  (D9) 

Then  H(uj)  is  bounded  if  A is  a stable  matrix. 

Proof:  Taking  the  norm  of  (D9),  we  have 

IIH(u))|I  - MBT(- j our  - A1)’1  ( j out  - A)"1  B 1| 


£l!BT(-j(II-AT)‘1!l  ||  (jo)I  - A)'1  B l| 
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< II ( jsul  - A)'1  B It2 
<;|(jO!l  -A)'ll|2  I!  B ||  2 

By  assumption,  A is  stable.  Hence  '! (SI  - A) |1  is  bounded.  Futhermore, 

S =j(jj 

B is  a constant  matrix  independent  of  id.  Thus  ||H(id)  !l  is  also  bounded. 

Let  us  recall  the  objective  is  to  examine  the  existence  of  a 

negative  definite  and  symmetric  solution  to  (D5).  Comparing  (D5)  with 

~ x - T 

the  (ARE),  they  are  identical  if  we  associate  S = BB  and  Q=C  C.  Hence 
Lemma  Dl  to  D3  may  be  utilized.  We  now  prove  the  following  result. 

Theorem  Dl : Consider  the  algebraic  Riccati  equation  (D5),  R^(N)=0. 

If  there  exist  a symmetric  equilibrium  point  N^<0  such  that  R^(N^)=0 
and  Re  \(F  -S  N^)  < 0,  then  there  also  exist  a symmetric  matrix  N2<N^<0 
such  that  R^(N2)  > 0. 

Proof:  By  hypothesis,  R^(N^)“0.  Denote 
N2  s - N*  < 0,  N*  > 0 
Consider  R^(N2),  we  have 

Rx(N2)  - (N^  - N*)F  +F*1  (N^  - N*)1*  (N^  - N*)S(N^  - N*)  - Q 

= (-N*)(F-SN1)  + (F  -S  Nl)T  (-N*)  - (-N*)S(-N*) 

’^Fj  +FjM*-M*SM*  (DIO) 

**  * * 

where  F^  =F  -SN^  is  a stable  matrix  and  M s-N  <0.  Next  consider  the 
perturbed  Riccati  equation  for  some  constant  k>0: 


M*Fl  + F^M*-  M*SM*  - kl  * 0 (Dll) 
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Applying  Lemma  D2  to  (Dll),  we  see  that  if  (i)  (F^,  Fc2^)  is  completely 
controllable;  (ii)  (F^>v4cl)  is  completely  observable,  then  a negative 

"ft  ru  *^* 

definite  and  symmetric  matrix  M with  the  property  Re  \(  -SM  ) <0 
exists  if  and  only  if 

(iii)  I -kF^21(- jml -F^)‘1(j®I-F1)'1Fc21  >0  Y® 

But  the  existence  of  a implies  (F,  Fc2^)  *-s  controllable  which  implies 

(F^,  Fc2^)  • (F  - S , Fc2i)  controllable  because  controllability  is 

preserved  under  state  feedback.  (F^, «/"kI)  is  clearly  observable. 

T T -1  -1 

Furthermore,  by  Lemma  D3,  Fc21(-Ju)I  * Fj_)  ( j uol  - F^)  Fc2^>0  is  bounded 

because  F^  is  stable  by  hypothesis.  Hence  there  always  exists  a real 

number  k>0  such  that  (iii)  holds.  Applying  Lemma  D3,  a unique  negative 

★ 

definite  and  symmetric  M exists.  Moreover, 

* * T * * ~ * 

R1(M)-MF1+F1M  -M  SM  - kl  > 0 

giving  N2  ” - N ■ + M <0.  In  view  of  (DIO),  then  R^(N2)  =■ 

★ 

R^(M  ) > 0.  This  completes  the  proof. 

Application  of  Theorem  Dl  allows  us  to  complete  the  proof  of 
Theorem  4.3.  To  see  this,  without  loss  of  generality,  choose  Q*I  in 
(4.50).  Then  from  (D2),  we  have 

~ — i i -i  i 

F « F + (H  + G K)PE 

- i — i i — i T 

S - (H  + G K)  (H  + (TK) 

~ i T i 

Q - E P PE 
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In  order  for  < 0 to  be  a solution  of  (D5),  from  Lemma  D2f  it  is  sufficient 
to  have  conditions  (a)-(c)of  Theorem  4.3  hold. Moreover,  the  solution 
satisfies  Re (F  -S  N^)  < 0.  Then  by  Theorem  Dl,  there  also  exists  a 
N2<0  such  that  R1(N2)  >0-  Let  M"_N2>0»  clearly  R(M)  < 0.  Thus  a 
positive  definite  and  symmetric  matrix  M exists.  By  Theorem  4.2,  A(M)  <0. 
Stability  and  robustness  conclusion  follows  from  (4.54). 


r 
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